
AN INVESTIGATION RELATING LONGITUDINAL PILOT-INDUCED 
OSCILLATION TENDENCY RATING TO DESCRIBING FUNCTION 
PREDICTIONS FOR RATE-LIMITED ACTUATORS 

THESIS 


Joel B. Witte, Major, USAF 
AFIT/GAE/ENY/04-M16 

DEPARTMENT OF THE AIR FORCE 
AIR UNIVERSITY 

AIR FORCE INSTITUTE OF TECHNOLOGY 

Wright-Patterson Air Force Base, Ohio 


APPROVED FOR PUBEIC REEEASE; DISTRIBUTION UNLIMITED 







The views expressed in this thesis are those of the author and do not refleet the official 
policy or position of the United States Air Force, Department of Defense, or the United 
States Government 



AFIT/G AE/ENY/04-M16 


AN INVESTIGATION REEATING EONGITUDINAE PILOT-INDUCED 
OSCILLATION TENDENCY RATING TO DESCRIBING FUNCTION 
PREDICTIONS EOR RATE-LIMITED ACTUATORS 

THESIS 


Presented to the Eaeulty 
Department of Aeronauties and Astronauties 
Graduate School of Engineering and Management 
Air Eorce Institute of Technology 
Air University 

Air Education and Training Command 
In Partial Eulfillment of the Requirements for the 
Degree of Master of Science in Aeronautical Engineering 


Joel B. Witte, BS 
Major, USAE 

March 2004 


APPROVED EOR PUBLIC RELEASE; DISTRIBUTION UNLIMITED. 



AFIT/G AE/ENY/04-M16 


AN INVESTIGATION REEATING EONGITUDINAL PILOT-INDUCED 
OSCILLATION TENDENCY RATING TO DESCRIBING EUNCTION 
PREDICTIONS EOR RATE-LIMITED ACTUATORS 


Joel B. Witte, BS 
Major, USAE 


Approved; 


Bradley S. Liebst (Chairman) 


date 


Richard G. Cobb (Member) 


date 


Russell G. Adelgren (Member) 


date 



AFIT/G AE/ENY/04-M16 


Abstract 

The purpose of this study was to investigate pilot-indueed oseillations (PIO) and 
determine a method by whieh a PIO tendeney rating eould be predieted. In partieular, 
longitudinal PIO in the presenee of rate-limited actuators were singled out for 
examination. Sinusoidal input/triangular output describing function techniques using 
Nichols charts were used. A new criterion dubbed Gap Criterion was calculated for PIO 
sensitivity. This criterion consists of the product of additional pilot gain and the 
normalized maximum amplitude of the commanded actuator necessary to cause PIO. 
These results were paired with simulator and flight test PIO tendency rating data. The 
PIO rating scale used was the PIO tendency classification of MIE-HDBK-1797. This 
concept was applied to two historical test databases, HAVE PREVENT and HAVE 
OEOP. Additional PIO data was gathered in the Earge Amplitude Multimode Aerospace 
Simulator (LAMARS) at the Air Eorce Research Laboratory (AERL), Wright-Patterson 
APB, Ohio and the USAP NP-16D Variable In-flight Stability Test Aircraft (VISTA) at 
Edwards APB, California. Correlation between PIO tendency rating and Gap Criterion 
was determined for each dataset. Most datasets exceeded a confidence level of 95% that 
a correlation existed. Pollow-on analysis for better curve fitting was accomplished; a 
logarithmic fit was judged best. Datasets were combined with success to demonstrate the 
universality of the Gap Criterion for correlating PIO tendency ratings for longitudinal 
PIO involving rate-limited actuators. 


IV 



Acknowledgements 


The Air Force Institute of Technology and the United States Air Force Test Pilot 
School cosponsored this study. I would like to thank the following people for their 
efforts and contributions: My thesis advisor, Dr Brad Liebst, who proposed this study and 
offered key insights; Mr. Andy Markofski and Mr. Mike Steen of General Dynamics 
Advanced Information Systems who programmed the aircraft dynamics for the VISTA 
NF-16D; the VISTA maintenance team who worked miracles to return the aircraft to 
flying status; Major Russ Adelgren and Mrs. Cynthia Roell, who made sure the flight test 
portion succeeded and Mr. Curt Clark and Mr. Jeff Slutz who worked diligently to ready 
the LAMARS simulator for the simulator test portion. 

I’d especially like to thank the members of the MAX GAP test team who made 
this project succeed: Captain Erik Monsen, Royal Norwegian Air Force; Captain Thomas 
Washington, USAF; Captain Kris Cowart, USAF and Captain Rich Salasovich, USAF. 
I’d also like to thank Major James Less, our Test Pilot School staff sponsor, and Major 
Rick Palo who survived multiple PIO sorties as safety pilot in the VISTA F-16. 

Most importantly. I’d like to thank my wife for her support, love and 
understanding through the trials of the past two and a half years. 


V 



Table of Contents 


Page 

Abstract.iv 

Acknowledgements.v 

Table of Contents.vi 

List of Figures.ix 

List of Tables.xv 

List of Notations and Symbols.xvii 

I. Introduction.1-1 

General.1-1 

Background.1-2 

PIO Defined.1-2 

PIO History.1-4 

PIO Categories.1-6 

PIO Category II.1-7 

PIO Scales.1-8 

PIO Prediction Methods.1-10 

Gap Criterion.1-11 

Objectives.1-11 

Approach.1-12 

Scope.1-12 

II. Theory.2-1 

Describing Function Development.2-1 

Saturation Nonlinearity Describing Function.2-3 

Closed Loop Describing Function Approximation.2-4 

Sinusoidal Input/Triangle Output Describing Function Approximation.2-7 

Applying Describing Function Results to Predict PIO.2-11 

Pilot Model.2-13 

Gap Criterion .2-16 

Gap Criterion Formulation.2-17 

Type 1.2-19 

Type II.2-20 

Type III.2-21 

Type IV.2-21 


VI 



































Page 

Example of Gap Criterion Applieation.2-21 

III. Analysis of Seleeted Historieal Data.3-1 

HAVE PREVENT Analysis.3-1 

Gap Criterion Caleulation for HAVE PREVENT Datasets.3-4 

HAVE PREVENT Gap Criterion Summary.3-7 

HAVE PREVENT Gap Criterion Correlation.3-8 

HAVE PREVENT Best Curve Eit.3-11 

HAVE OEOP Analysis.3-14 

Gap Criterion Caleulation for HAVE OEOP Datasets.3-15 

HAVE OEOP Gap Criterion Summary.3-19 

HAVE OEOP Gap Criterion Correlation.3-19 

HAVE OEOP Best Curve Pit.3-21 

HAVE PREVENT and HAVE OEOP Summary.3-24 

IV Analysis of Project MAX GAP (EAMARS) Data.4-1 

MAX GAP (EAMARS) Analysis.4-1 

Gap Criterion Calculation for MAX GAP (EAMARS) Datasets.4-2 

MAX GAP (EAMARS) Gap Criterion Summary.4-5 

MAX GAP (EAMARS) Gap Criterion Correlation.4-5 

MAX GAP (EAMARS) Best Curve Pit.4-8 

MAX GAP (EAMARS) Summary.4-11 

V. Analysis of Project MAX GAP (VISTA) Data.5-1 

MAX GAP (VISTA) Analysis.5-1 

Gap Criterion Calculation for MAX GAP (VISTA) Datasets.5-2 

MAX GAP (VISTA) Gap Criterion Summary.5-6 

MAX GAP (VISTA) Gap Criterion Correlation.5-6 

MAX GAP (VISTA) Best Curve Pit.5-8 

MAX GAP (VISTA) Summary.5-10 

VI. Analysis of Combined Gap Criterion Data.6-1 

EAMARS Combined Datasets.6-1 

VISTA Combined Datasets.6-3 

EAMARS and VISTA Combined Dataset Correlation.6-4 

Combined Dataset Analysis and Observations.6-5 


vii 


VIE Conclusions 


7-1 




































Page 


Appendix A. Matlab/Simulink™ Code.A-1 

Appendix B. State-Spaee Matriees for Projeet MAX GAP.B-1 

Appendix C. Correlation Computation.C-1 

Appendix D. MAX GAP Histograms.D-1 

Bibliography.BIB-1 

Vita.VITA-1 


viii 









List of Figures 


Figure Page 

1-1. YF-22A Aecident Sequenee (Hodgkinson, 1999:128).1-4 

1-2. Aetuator Saturation Example Using an Input = A sin(o)i t).1-8 

1 -3. Simulink™ Aetuator Model.1-8 

1- 4. PIO Tendency Classification (MlL-HDBK-1797, 1997:152).1-9 

2- 1. Example of a Nonlinear System.2-1 

2-2. Saturation Nonlinearity and the Corresponding Input-Output Relationship (Slotine 
and Ei, 1995:173).2-3 

2-3. Actuator Model Development (Klyde and others, 1995:22).2-5 

2-4. Closed Eoop Actuator Transfer function Diagram.2-6 

2-5. Rate-Eimiting Input and Output (Klyde and others, 1995:42-46).2-8 

2-6. Describing function Phase Angle Comparison.2-10 

2-7. Pitch Tracking Closed Eoop System.2-11 

2-8. Simplified Pitch Tracking Closed Eoop System.2-11 

2-9. Neal-Smith Pilot Model Constraints.2-15 

2-10. Pitch Tracking Closed Eoop System for Gap Criterion .2-16 

2-11. four Resulting Gap Criterion Types.2-18 

2-12. Case I Effective Pilot Gain Increase.2-19 

2-13. Case II Effective Pilot Gain Decrease.2-20 

2- 14. Nichols Chart of the Example Problem.2-22 

3- 1. Phase 2 Sum-of-sines Pitch Tracking Task.3-2 

3-2. Phase 3 Discrete HUD Pitch Tracking Task.3-2 


IX 























Figure Page 

3-3. Phase 3 Target Traeking Task.3-3 

3-4. Longitudinal State Spaee Diagram (Matlab/Simulink™, 2001).3-4 

3-5. HAVE PREVENT Niehols Charts for Cases A, B and C.3-6 

3-6. HAVE PREVENT Phase 2 Sum-of-sines Task EAMARS Data.3-9 

3-7. HAVE PREVENT Phase 3 Diserete HUD Piteh Traeking Task EAMARS Data.. 3-9 

3-8. HAVE PREVENT Phase 3 Target Traeking Task LAMARS Data.3-10 

3-9. HAVE PREVENT Phase 2 Sum-of-sines Task EAMARS Data with Eogarithmie 
Curve Eit.3-12 

3-10. HAVE PREVENT Phase 3 Discrete HUD Pitch Tracking Task LAMARS Data 
with Logarithmic Curve Pit.3-13 

3-11. HAVE PREVENT Phase 3 Target Tracking Task LAMARS Data with 

Logarithmic Curve Pit.3-13 

3-12. HAVE OEOP Nichols Charts for Cases A, B and C.3-17 

3-13. HAVE OEOP Phase 2 Sum-of-sines Task VISTA Data.3-20 

3-14. HAVE OLOP Phase 3 Discrete HUD Pitch Tracking Task VISTA Data.3-20 

3-15. HAVE OEOP Phase 2 Sum-of-sines Task VISTA Data with Eogarithmie Pit... 3-23 

3- 16. HAVE OLOP Phase 3 Discrete HUD Pitch Tracking Task VISTA Data with 

Logarithmic Pit.3-23 

4- 1. MAX GAP (LAMARS) Nichols Charts for Cases B, N, W and Y.4-3 

4-2. MAX GAP (LAMARS) Phase 2 Sum-of-sines Task Data.4-6 

4-3. MAX GAP (LAMARS) Phase 3 Discrete HUD Pitch Tracking Task Data.4-6 

4-4. MAX GAP (LAMARS) Phase 3 Target Tracking Task Data.4-7 

4-5. MAX GAP (LAMARS) Phase 2 Sum-of-sines Task Data with Logarithmic Curve 
Pit.4-9 


X 




















Page 


Figure 

4-6. MAX GAP (LAMARS ) Phase 3 Diserete HUD Piteh Traeking Task Data with 


Logarithmie Fit.4-10 

4- 7. MAX GAP (LAMARS) Phase 3 Target Traeking Task Data with Logarithmie 

Fit.4-10 

5- 1. MAX GAP (VISTA) Niehols Charts for Cases B, N, W and Y.5-4 

5-2. MAX GAP (VISTA) Phase 2 Sum-of-sines Task Data.5-7 

5-3. MAX GAP (VISTA) Phase 3 Diserete HUD Piteh Traeking Task Data.5-7 

5-4. MAX GAP (VISTA) Phase 2 Sum-of-sines Task Data with Logarithmic Curve 

Fit.5-9 

5- 5. MAX GAP (VISTA) Phase 3 Discrete HUD Pitch Tracking Task Data with 

Logarithmic Curve Fit.5-10 

6- 1. LAMARS Combined Phase2 Sum-of-sines Dataset.6-1 

6-2. LAMARS Combined Phase 3 Discrete (HUD) Pitch-Tracking Dataset.6-2 

6-3. LAMARS Combined Phase3 Target Tracking Dataset.6-2 

6-4. VISTA Combined Phase 2 Sum-of-sines Dataset.6-3 

6-5. VISTA Combined Phase 3 Discrete (HUD) Pitch-Tracking Dataset.6-3 

6-6. LAMARS and VISTA Combined Phase 2 Sum-of-sines Data.6-4 

6-7. LAMARS and VISTA Combined Phase 3 Discrete Pitch-Tracking Data.6-4 

A-1. Augmented Dynamics Simulink™ Model.A-4 

D-l. LAMARS Phase 2 Sum-of-sines Data, Case B, 15 deg/sec.D-1 

D-2. LAMARS Phase 2 Sum-of-sines Data, Case B, 30 deg/sec.D-2 

D-3. LAMARS Phase 2 Sum-of-sines Data, Case B, 60 deg/sec.D-2 

D-4. LAMARS Phase 2 Sum-of-sines Data, Case N, 15 deg/sec.D-3 

D-5. LAMARS Phase 2 Sum-of-sines Data, Case N, 30 deg/sec.D-3 


XI 























Page 


Figure 

D-6. LAMARS Phase 2 Sum-of-sines Data, Case N, 60 deg/see.D-4 

D-7. LAMARS Phase 2 Sum-of-sines Data, Case W, 15 deg/see.D-4 

D-8. LAMARS Phase 2 Sum-of-sines Data, Case W, 30 deg/see.D-5 

D-9. LAMARS Phase 2 Sum-of-sines Data, Case W, 60 deg/see.D-5 

D-10. LAMARS Phase 2 Sum-of-sines Data, Case Y, 15 deg/see.D-6 

D-11. LAMARS Phase 2 Sum-of-sines Data, Case Y, 30 deg/see.D-6 

D-12. LAMARS Phase 2 Sum-of-sines Data, Case Y, 60 deg/see.D-7 


D-13. LAMARS Phase 3 Diserete HUD Piteh Traeking Data, Case B, 15 deg/see.D-8 

D-14. LAMARS Phase 3 Diserete HUD Piteh Traeking Data, Case B, 30 deg/see.D-8 

D-15. LAMARS Phase 3 Diserete HUD Piteh Traeking Data, Case B, 60 deg/see.D-9 

D-16. LAMARS Phase 3 Diserete HUD Pitch Tracking Data, Case N, 15 deg/see.D-9 

D-17. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case N, 30 deg/see ... D-10 
D-18. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case N, 60 deg/see ... D-10 
D-19. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case W, 15 deg/see... D-11 
D-20. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case W, 30 deg/see... D-11 
D-2L LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case W, 60 deg/see... D-12 
D-22. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case Y, 15 deg/see ... D-12 
D-23. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case Y, 30 deg/see ... D-13 
D-24. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case Y, 60 deg/see ... D-13 


D-25. LAMARS Phase 3 Target Tracking Data, Case B, 15 deg/see.D-14 

D-26. LAMARS Phase 3 Target Tracking Data, Case B, 30 deg/see.D-14 

D-27. LAMARS Phase 3 Target Tracking Data, Case B, 60 deg/see.D-15 


xii 

















Figure Page 

D-28. LAMARS Phase 3 Target Traeking Data, Case N, 15 deg/see.D-15 

D-29. LAMARS Phase 3 Target Traeking Data, Case N, 30 deg/see.D-16 

D-30. LAMARS Phase 3 Target Traeking Data, Case N, 60 deg/see.D-16 

D-3L LAMARS Phase 3 Target Traeking Data, Case W, 15 deg/see.D-17 

D-32. LAMARS Phase 3 Target Traeking Data, Case W, 30 deg/see.D-17 

D-33. LAMARS Phase 3 Target Traeking Data, Case W, 60 deg/see.D-18 

D-34. LAMARS Phase 3 Target Traeking Data, Case Y, 15 deg/see.D-18 

D-35. LAMARS Phase 3 Target Traeking Data, Case Y, 30 deg/see.D-19 

D-36. LAMARS Phase 3 Target Traeking Data, Case Y, 60 deg/see.D-19 

D-37. VISTA Phase 2 Sum-of-sines Data, Case B, 15 deg/see.D-20 

D-38. VISTA Phase 2 Sum-of-sines Data, Case B, 30 deg/see.D-20 

D-39. VISTA Phase 2 Sum-of-sines Data, Case B, 60 deg/see.D-21 

D-40. VISTA Phase 2 Sum-of-sines Data, Case N, 15 deg/see.D-21 

D-4L VISTA Phase 2 Sum-of-sines Data, Case N, 30 deg/see.D-22 

D-42. VISTA Phase 2 Sum-of-sines Data, Case N, 60 deg/see.D-22 

D-43. VISTA Phase 2 Sum-of-sines Data, Case W, 15 deg/see.D-23 

D-44. VISTA Phase 2 Sum-of-sines Data, Case W, 30 deg/see.D-23 

D-45. VISTA Phase 2 Sum-of-sines Data, Case W, 60 deg/see.D-24 

D-46. VISTA Phase 2 Sum-of-sines Data, Case Y, 15 deg/see.D-24 

D-47. VISTA Phase 2 Sum-of-sines Data, Case Y, 30 deg/see.D-25 

D-48. VISTA Phase 2 Sum-of-sines Test Data, Case Y, 60 deg/see.D-25 

D-49. VISTA Phase 3 Diserete HUD Piteh Traeking Data, Case B, 15 deg/see.D-26 


xiii 

























Figure 

D-50. VISTA Phase 3 Diserete 
D-51. VISTA Phase 3 Discrete 
D-52. VISTA Phase 3 Discrete 
D-53. VISTA Phase 3 Discrete 
D-54. VISTA Phase 3 Discrete 
D-55. VISTA Phase 3 Discrete 
D-56. VISTA Phase 3 Discrete 
D-57. VISTA Phase 3 Discrete 
D-58. VISTA Phase 3 Discrete 
D-59. VISTA Phase 3 Discrete 
D-60. VISTA Phase 3 Discrete 


HUD Pitch Tracking Data, 
HUD Pitch Tracking Data, 
HUD Pitch Tracking Data, 
HUD Pitch Tracking Data, 
HUD Pitch Tracking Data, 
HUD Pitch Tracking Data, 
HUD Pitch Tracking Data, 
HUD Pitch Tracking Data, 
HUD Pitch Tracking Data, 
HUD Pitch Tracking Data, 
HUD Pitch Tracking Data, 



Page 

Case B, 30 deg/sec. 

....D-26 

Case B, 30 deg/sec. 

....D-27 

CascN, 15 deg/sec.... 

....D-27 

Case N, 30 deg/sec .... 

....D-28 

Case N, 60 deg/sec .... 

....D-28 

Case W, 15 deg/sec ... 

....D-29 

Case W, 30 deg/sec ... 

....D-29 

Case W, 60 deg/sec ... 

....D-30 

Case Y, 15 deg/sec .... 

....D-30 

Case Y, 30 deg/sec .... 

....D-3I 

Case Y, 60 deg/sec .... 

....D-3I 


XIV 














List of Tables 


Table Page 

1-1. Summary of Famous Longitudinal PIO Events (McRuer, 1995:9).1-4 

1- 2. PIO Tendency Rating Scale (MIL-HDBK-1797, 1997:153).1-10 

2- 1. Neal-Smith Pilot Models.2-14 

3- 1. HAVE PREVENT Case Characteristics (Hanley, 2003).3-3 

3-2. HAVE PREVENT Pitch-to-Actuator Transfer Eunctions ().3-4 

3-3. HAVE PREVENT Neal-Smith Pilot Models.3-5 

3-4. HAVE PREVENT Components for Cases A and B.3-6 

3-5. Gap Criteria Values for HAVE PREVENT Cases A and B.3-7 

3-6. Gap Criteria for HAVE PREVENT Case C.3-7 

3-7. HAVE PREVENT Gap Criteria Summary.3-8 

3-8. HAVE PREVENT Correlation Confidence Eevels.3-11 

3-9. HAVE PREVENT Curve Eit Correlation Values.3-11 

3-10. HAVE OEOP Case Characteristics (Gilbreath, 2001).3-15 

3-11. HAVE OEOP Pitch-to-Actuator Transfer Eunctions ( G^) .3-15 

3-12. HAVE OEOP Neal-Smith Pilot Models.3-16 

3-13. HAVE OEOP Components for Cases A and C.3-17 

3-14. Gap Criteria Values for HAVE OEOP Case A and C.3-18 

3-15. HAVE OEOP Gap Criteria Summary.3-19 

3-16. HAVE OEOP Correlation Confidence Eevels.3-21 

3- 17. HAVE OEOP Curve Pit Correlation Values.3-22 

4- 1. MAX GAP (LAMARS) Case Characteristics (Witte and others, 2003).4-1 


XV 
























Table Page 

4-2. MAX GAP (LAMARS) Piteh-to-Aetuator Transfer Funetions (G^) .4-2 

4-3. MAX GAP (LAMARS) Neal-Smith Pilot Models.4-3 

4-4. MAX GAP (LAMARS) Components for Cases B, N, W and Y.4-4 

4-5. Gap Criteria Values for MAX GAP (LAMARS) Cases B, N, W and Y.4-4 

4-6. MAX GAP (LAMARS) Gap Criteria Summary.4-5 

4-7. MAX GAP (LAMARS) Correlation Confidenee Levels.4-8 

4- 8. MAX GAP (LAMARS) Curve Fit Correlation Values.4-8 

5- 1. MAX GAP (VISTA) Case Characteristies (Witte and others, 2003).5-2 

5-2. MAX GAP (VISTA) Pitch-to-Aetuator Transfer Funetions {G^) .5-2 

5-3. MAX GAP (VISTA) Neal-Smith Pilot Models.5-3 

5-4. MAX GAP (VISTA) Components for Cases B and W.5-4 

5-5. Gap Criteria Values for MAX GAP (VISTA) Cases B and W.5-5 

5-6. MAX GAP (VISTA) Components for Case N.5-5 

5-7. Gap Criteria Values for MAX GAP (VISTA) Case N.5-5 

5-8. Gap Criteria for MAX GAP (VISTA) Case Y.5-6 

5-9. MAX GAP (VISTA) Gap Criteria Summary.5-6 

5-10. MAX GAP (VISTA) Correlation Confidenee Levels.5-8 

5-11. MAX GAP (VISTA) Curve Fit Correlation Values.5-9 

C-1. Minimum Values of the Correlation Coeffieient for Confidenee Level 

(Wheeler and Ganji, 1996:147).C-2 


XVI 






















List of Notations and Symbols 


Symbol 

A 

Amax 

AFIT 

AFRL 

a, Alpha 

dB 

deg 

6 

DoD 
e, E 
G(s) 

Gactuator 

Gaugmented 

GC 

Ge(s) 

Gp(s) 

HQDT 

HUD 

jO) 


Definition Unit 

Commanded Actuator Deflection deg 

Maximum Actuator Deflection Available deg 

Air Force Institute of Technology 

Air Force Research Laboratories 

Angle-of-Attack deg 

Decibels 

Degrees 

Actuator Deflection Angle deg 

Phase Angle rad 

Department of Defense 
Error 

Generic Laplacian Transfer Eunction 
Actuator Transfer Eunction 
Augmented Aircraft Transfer Eunction 
Gap Criterion 

Bare Aircraft Transfer Eunction 
Neal-Smith Pilot Model Transfer Eunction 
Handling Qualities During Tracking 
Heads Up Display 
Imaginary Laplacian Term 

xvii 



Symbol 

Definition 

Unit 

k 

Feedback Gain Matrix 

- 

K* 

Intermediate Variable 

- 

Kp 

Neal-Smith Pilot Gain 

- 

Kfl? Kaipha 

Angle-of-Attack Feedback Gain 

- 

Kq, Kq 

Pitch Rate Feedback Gain 

- 

LAMARS 

Large Amplitude Multimode Aerospace Simulator 

- 

Ln 

Natural Logarithm 

- 

MIL HDBK 1797 

Military Handbook 1797 

- 

n 

Number of Datapoints 

- 

N(A, ro) 

Describing Function 

- 

OLOP 

Open Loop Onset Point 

- 


Phase Angle 

deg 

(X> 

Frequency 

rad/sec 

(Oa 

Actuator Gain 

- 

a>Bw 

Band Width Frequency 

rad/sec 

(^sp 

Short Period Natural Frequency 

rad/sec 

PIO 

Pilot-induced Oscillations 

- 

PIOR 

Pilot-induced Oscillation Tendency Rating 

- 

q 

Aircraft Pitch Rate 

deg/sec 

R, % 

Correlation Factor 

- 

rad 

Radians 

- 

s 

Laplacian Operator 

- 


xviii 




Symbol 

Definition 

Unit 

sec 

Seconds 

- 

0, Theta 

Aircraft Pitch Angle 

deg 

T2 

Time to Double Amplitude 

sec 

TLag 

Neal-Smith Lag Time Constant 

sec 

^Lead 

Neal-Smith Lead Time Constant 

sec 

USAF TPS 

United States Air Force Test Pilot School 

- 

V 

True Velocity 

ft/sec 

VISTA 

Variable In-flight Stability Test Aircraft 

- 

Pl 

Actuator Rate Limit 

deg/sec 

Csp 

Short Period Damping Ratio 

- 


XIX 



AN INVESTIGATION RELATING LONGITUDINAL PILOT-INDUCED 


OSCILLATION TENDENCY RATING TO DESCRIBING LUNCTION 
PREDICTIONS EOR RATE-LIMITED ACTUATORS 


I. Introduction 


General 

The purpose of this study was to investigate pilot-induced oscillations (PIO) and 
determine a new method by which PIO tendency rating could be predicted. In particular, 
longitudinal PIO in the presence of rate-limited actuators were singled out for 
examination. The PIO rating scale used in this investigation was the PIO tendency 
classification of the Department of Defense Interface Standard Plying Qualities of Piloted 
Aircraft (MIL-HDBK-1797, 1997; 152). While there are a number of PIO prediction 
methods already published, this study will attempt a new approach. 

This study was originated at the Air Porce Institute of Technology (AFIT), 
Wright-Patterson AFB, Ohio and was supported by the United States Air Force Test Pilot 
School (USAF TPS). Research was conducted in both the Large Amplitude Multimode 
Aerospace Simulator (LAMARS) at the Air Force Research Laboratory (AFRL), Wright- 
Patterson AFB, Ohio and in the USAF NF-16D Variable In-flight Stability Test Aircraft 
(VISTA) at Edwards AFB, CA. The VISTA aircraft is operated by USAF TPS and 
supported by General Dynamics Advanced Information Systems of Buffalo, NY. 


1-1 



Background 

Pilot-induced oscillations have been an aviation problem for over 100 years now. 
The first incidence can be traced back to Wilbur and Orville Wright in 1903. When the 
two brothers first took to the skies of Kitty Hawk, North Carolina, they experienced “a 
mild longitudinal oscillation of the Wright Flyer” (Duda, 1995:288). The PIO problem 
had just begun. 

PIO Defined. 

Before continuing with the century-long history of PIO, an understanding of the 
term PIO is in order. A pilot-induced oscillation can be described as “an inadvertent, 
sustained aircraft oscillation which is the consequence of an abnormal joint enterprise 
between the aircraft and the pilot” (McRuer, 1995:2). Elaborated, a PIO is a complex 
interaction between a pilot and his active involvement in an aircraft feedback system 
(Klyde and others, 1995:14). The United State Department of Defense (DoD) defines 
PIO as “sustained or uncontrollable oscillations resulting from the efforts of the pilot to 
control the aircraft” (MIL-HDBK-1797, 1997:151). Although the key causal factor in 
pilot-induced oscillation seems to be the pilot, it is important to make the assertion that, 
generally, the pilot is not at fault and that there seems to be embedded in the flight control 
system of the aircraft some tendencies predisposing the pilot-aircraft system toward PIO 
occurrence (Klyde and others, 1995:14). In recent times, new terms have been put forth 
to replace the familiar PIO such that the pilot’s guilt in such events is less likely to be 
assumed. These include aircraft-pilot coupling (APC), pilot-in-the-loop oscillations and 
pilot-assisted (or augmented) oscillations (Klyde and others, 1995:14). However, 
experienced test pilots, including instructors at the US test pilot schools, and people in the 
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handling qualities community have expressed widespread allegiance to the traditional 
term PIO and, therefore, this term will be used throughout this study (Mitchell and Hoh, 
1995:16; Klyde and others, 1995:14). 

In addition to defining what a PIO is, it is just as important to define what it is not. 
A PIO could mean any oscillation that occurs during manual, piloted control. But some 
of these situations could be the result of pilot overcontrol such as when a student pilot is 
learning to land and balloons the aircraft. To an outsider, this could look like a PIO but 
really is just part of standard pilot compensation lasting no more than one or two cycles 
and is not a “real” PIO (Mitchell and Hoh 1995:17). Other researchers describe these as 
“minor bobbles” that are often encountered as pilots get used to a new aircraft and is just 
part of the learning experience (Klyde and others, 1995:14). It is also important to realize 
that motions resulting from poor damping of the short period or dutch roll modes are not 
PIO, when the motion does not result from the “efforts of the pilot to control the aircraft” 
(Mitchell and Hoh, 1995:17-18). 

To distinguish between these examples and a true PIO, some leading researchers 
propose the following additional definition of PIO: “A PIO exists when the airplane 
attitude, angular rate, or normal acceleration is 180 degrees out of phase with the pilot’s 
control inputs” (Mitchell and Hoh, 1995:18). A great example of this phase lag can be 
seen in Figure 1-1. This is the recorded data of the YF-22A accident which occurred on 
25 April 1992 during a planned go-around at low altitude. This stripchart data depict a 
180 degree phase difference between the aircraft pitch attitude and stick input. 
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Figure 1-1. YF-22A Accident Sequence (Hodgkinson, 1999:128) 

FIO History. 

The YF-22A PIO occurrence is just one of the most recent events. There is a long 
history of PIO events in both operational and test flying as shown in Table 1-1. 

_Table 1-1. Summary of Famous Longitudinal PIO Events (McRuer, 1995:9)_ 


Aircraft Type 

Summary of Incident 

XS-1 

XF-89A 

F-lOO 

X-15 

XF2Y-1 

YF-12 

Space Shuttle 
DFBW F-8 
YF-22 

JAS 39 
MD-11 

F-4 

PIO during gliding approach and landing, 24 Oct 1947 

PIO during level off from dive recovery, early 1949 

PIO during tight maneuvering 

Gliding flight approach and landing, 8 Jun 1959; Category 11 PIO 
Post-takeoff destructive PIO 

Mid-frequency severe PIO; Category 111 PIO 

ALT-5 during landing approach glide, 26 Oct 1977; Category 11 PIO 

PIO during touch and goes, 18 Apr 1978; Category 111 PIO 

PIO after touchdown and wave off in afterburner, 25 Apr 1992 

PIO during approach, 1990; 1993; Category 11 - 111 PIO 

China Eastern Airlines Fit 583, 6 Apr 1993; Inadvertant slat deployment 
Low altitude record run second pass, 18 May 1961; Destructive PIO 
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The onset of PIO oeeurs when the pilot attempts tight eontrol. The DoD defines 
Category A Flight Phases as “those nonterminal Flight Phases that require rapid 
maneuvering, preeision tracking, or precise flight path control” (MIL-HDBK-1797, 
1997:80). Types of maneuvers included in this category are in-flight refueling (receiver), 
air-to-air combat, and formation flying (MIL-HDBK-1797, 1997:80). Category C Flight 
Phases also require “accurate flight-path control” and include takeoffs, approaches and 
landings (MIL-HDBK-1797, 1997:80). Almost all of the events listed in Table 1-1 fall 
into Category A or Category C. 

PIO can range in severity from benign to catastrophic (Anderson and Page, 
1995:278). Benign PIO may not lead to loss of aircraft or life, but they can affect 
operational missions. For example, receiver air-refueling may take longer than expected 
causing delays in mission progress (Anderson and Page, 1995:278). This is still far easier 
to accept than the more severe extreme in which aircraft and pilots have both been lost 
due to PIO. On 18 May 1961, US Navy pilot Cmdr Jack Feldman and his F-4B aircraft 
were lost when a PIO disintegrated his aircraft during the second pass of a low altitude 
speed record attempt due to PIO related to low short-period damping (McCruer, 1995:9). 

Even worse, the potential for PIO has actually increased due to the evolving use 
of highly augmented, fly-by-wire aircraft (Liebst and others, 2002:740). Development 
flight test of the Boeing 777, C-17A and Saab JAS 39 Gripen bear this out. The 777, a 
fly-by-wire transport, encountered a PIO situation during a Flaps 20 landing. The 
spoilers automatically deployed upon touchdown and the pilot countered with forward 
column motion resulting in a PIO that lasted for “about 3 cycles” (Dornheim, 1995:32). 
C-17 longitudinal PIO tendencies were discovered during dutch roll testing, air-refueling 
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breakaways and three-engine landings. Additionally, further PIO tendeneies were 
exposed during handling qualities during traeking (HQDT) exereises with an A-37 target 
aireraft (Preston and others, 1996:20-49). The discovery of PIO tendencies in the JAS 39 
was not so uneventful. Two aircraft were lost during different stages of aircraft 
development. The first accident occurred in 1989 with the test aircraft having had only 
5.3 hours of flight time when, during a landing attempt, it experienced “roll pendulums” 
at low altitude and later “pendular movements in pitch, also” at an altitude of 
approximately 10 to 15 meters. The mishap pilot attempted a go-around but the aircraft 
“hit the runway with the left wingtip and main gear as well as the nose portion” (Ahlgren, 
1989:12). The pilot survived and returned to test flying the JAS 39. In 1993 while 
performing in an airshow in Stockholm, Sweden, he experienced a lateral PIO 
compounded with an uncommanded pitch up to high angle-of-attack. The aircraft 
diverged from controlled flight but the pilot ejected safely (Jensen and others, 
undated: 12). 

PIO Categories. 

PIO can be divided into three categories (McRuer, 1995:79-80). Category I PIO 
are essentially linear pilot-vehicle system oscillations; they are usually the low frequency 
consequence of excessive high frequency lag in the aircraft’s linear dynamics (Klyde and 
others, 1996:17). On the other hand. Category III PIO are associated with essentially 
nonlinear pilot-vehicle systems with transitions; they are the result of abrupt shifts in 
either the effective controlled-element dynamics or in the pilot’s behavioral dynamics 
(Klyde and others, 1996:17). Category II PIO are defined as quasi-linear pilot-vehicle 
system oscillations associated with control surface rate or position limiting (McRuer, 
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1995:80). In other words, rate-lmited actuators. They represent a transition from linear 
dynamics to nonlinear effects and were the focus of this investigation. 

PIO Category 11. 

One reason for focusing on Category II PIO is that “almost all of the severe PIO 
time history records available for operational and flight test aircraft ... show surface rate 
limiting .. .in the fully developed oscillation” (Klyde and others, 1996:15). Other 
researchers have similar opinions: “It seems to be true that all recent PIO have exhibited 
rate saturation” (Duda , 1995:289). A prime example is the development of the C-17 in 
which “rate limiting was involved in all the subject [PIO] events and is viewed to be the 
primary cause of the longitudinal PIO” (Preston and others, 1996:20). 

There are two major detrimental effects of rate limiting. One is that it adds to the 
effective lag in series with the pilot therefore making the effective aircraft dynamics 
worse and the other is that it exposes the bare aircraft dynamics in stability augmented 
aircraft. On the positive side, however, rate limiting tends to confine the ultimate 
amplitude of the pilot-vehicle system oscillation (Klyde and others, 1996:15). Figure 1-2 
shows the differences in the output of a typical first-order actuator as the effects of 
increasing amplitude drive the system toward rate limiting. The figure displays the 
characteristic triangular wave pattern of the actuator position reversing when equal to the 
commanded position. The “boxcar-like” rate response is clipped at 40 deg/sec in this 
example and is also a trait of a rate-limited actuator (Klyde and others, 1996:25). The 
output was generated using the Matlab^'^/Simulink^'^ software model which is shown in 
Figure 1-3 (Matlab™/Simulink™, 2001). 
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Mg = 20 rad/sec; = 40 deg/sec; m. = 5 rad/sec; A = 15 deg 
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Figure 1-2. Actuator Saturation Example Using an Input = A sin(o)i t) 



Actuator 


Figure 1-3. Simulink™ Actuator Model 


PIO Scales. 

Before discussing PIO prediction, a scale must be selected which distinguishes 
increasing severity of PIO. Figure 1-4 shows just such a scale, the PIO tendency 
classification (MIF-HDBK-1797, 1997:152). This scale is in common use among test 
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pilots to rate the suseeptibility of aireraft to PIO and a large amount of historical data is 
available based on this scale. Comparing this scale to Cooper-Harper Handling Qualities 
Levels, a PIO rating of 1 or 2 is approximately equivalent to a Level 1 aircraft, a PIO 
rating of 3 or 4 is similar to a Level 2 aircraft, a PIO rating of 5 is Level 3 and a PIO 
rating of 6 is extremely dangerous (MIL-HDBK-1797, 1997:151). These PIO ratings are 
more fully described in the PIO tendency rating scale of Table 1-2 (MIL-HDBK-1797, 
1997:322). 



Figure 1-4. PIO Tendency Classification (MIL-HDBK-1797, 1997:152) 
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Table 1-2. PIO Tendency Rating Scale (MIL-HDBK-1797, 1997:153) 


DESCRIPTION 

NUMERICAL 

RATING 

No tendency for pilot to induce undesirable motions. 

I 

Undesirable motions tend to occur when pilot initiates abrupt maneuvers 
or attempts tight control. These motions can be prevented or eliminated 
by pilot technique. 

2 

Undesirable motions easily induced when pilot initiates abrupt 
maneuvers or attempts tight control. These motions can be prevented or 
eliminated but only at sacrifice to task performance or through 
considerable pilot attention and effort. 

3 

Oscillations tend to develop when pilot initiates abrupt maneuvers or 
attempts tight control. Pilot must reduce gain or abandon task to 
recover. 

4 

Divergent oscillations tend to develop when pilot initiates abrupt 
maneuvers or attempts tight control. Pilot must open loop by releasing 
or freezing the stick. 

5 

Disturbance or normal pilot control may cause divergent oscillation. 

Pilot must open control loop by releasing or freezing the stick. 

6 


PIO Prediction Methods. 

Using this scale, several criteria for PIO prediction have been developed for 
Category I and Category II PIO (Mitchell and Klyde, 1998:417-426). Category I PIO 
prediction methods include the Bandwidth/Pitch Rate Overshoot Method, the original 
Neal-Smith criteria, the Neal-Smith criteria as modified by the Moscow Aviation 
Institute, Smith-Geddes PIO criteria, and the Gibson criteria (Mitchell and Klyde, 
1998:417-426). A thorough examination of these methods led Mitchell and Klyde to 
conclude that “we are in reasonably good shape in predicting Category I PIO” (Mitchell 
and Klyde, 1998:417-426). Satisfactory development of Category II PIO prediction 
methods, on the other hand, is not as complete. 
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Some work in Category II prediction methods has been accomplished or is in 
progress. These efforts include modifying the Bandwidth/Phase Delay criteria to 
Category II cases, the Time-domain Neal-Smith criteria, the Open Loop Onset Point 
(OLOP) criteria and a power spectral density method using a structural model of the 
human pilot (Mitchell and Klyde, 1998:417-426). These efforts continue despite the 
assertion by Anderson and Page that “.. .the adaptive nature of the pilot makes such 
oscillations [PIO] difficult to predict” (Anderson and Page, 1995:278). 

Gap Criterion. 

The Department of Aeronautical and Astronautical Engineering at the Air Force 
Institute of Technology (AFIT) now proposes a new criterion for predicting PIO ratings 
dubbed the Gap Criterion. It is based on describing function techniques, modified Neal- 
Smith pilot models and actuator input amplitude ratios. The goal of this study was to 
determine if specific relationships between Gap Criterion and PIO tendency rating for 
Category II PIO due to rate-limited actuators exists and, if so, to what extent. 

Objectives 

The primary objective of this study was to develop a new criterion for predicting 
PIO tendency rating by: 

1) Exploiting previously defined describing function methods for determining 

Category II PIO characteristics based on rate-limited actuators. 

2) Defining Gap Criterion. 

3) Applying the new method to existing historical data from similar test programs. 

4) Conducting both simulator and flight tests to expand this database. 

5) Making recommendations on the implementation of this new criterion. 
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Approach 

The following steps were taken for this projeet: 

1) The Gap Criterion was applied to data from previous simulator and flight test 
projects in which rate limiting PIO effects were studied. These included USAF 
TPS projects HAVE OLOP and HAVE PREVENT (Gilbreath, 2001; Hanley, 

2003). The Gap Criterion was calculated for each test case of bare aircraft 
dynamics and rate-limit. These Gap Criteria were then matched with their 
respective PIO tendency ratings and plotted in pairs. Correlation probability 
confidence level was then determined along with curve fits. 

2 ) Based on the observed data from these studies, a broader range of longitudinal 
flight control system dynamics with varying short period characteristics were 
chosen to augment the database. These configurations were tested in both the 
EAMARS simulator and the VISTA NP-16D aircraft. 

Scope 

This research project was limited in scope and constrained in certain areas: 

1. The PIO investigated were strictly longitudinal. Category II PIO due to rate 
limiting of the actuator. 

2. Only three rate limits were chosen: 15 deg/sec, 30 deg/sec and 60 deg/sec. 

3. Only four distinct bare aircraft dynamics cases were tested. 

4. Tracking tasks were created with HUD generated and target aircraft sorties. No 
offset landing tasks were planned. 

5. Due to schedule and budget, the simulator test portion was limited to two days and 
three pilots. The flight test portion was limited to eight sorties and 10.8 hour 
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II. Theory 


This chapter will discuss describing functions and how they can be used to 
understand and predict PIO onset when considered in the context of rate-limited 
actuators. Further, the Neal-Smith pilot model will be explained followed by an example 
integrating all of these concepts. The basis of the Gap Criterion will then be covered. 

Describing Function Development 

Observing the time history of the YF-22 PIO from Figure 1-1, it can be seen that 
the input is approximately sinusoidal. This is true in general of all PIO incidents (Klyde 
and others, 1996:37). The describing function technique can be used for limit cycle 
analysis due to the faet that that the form of the signals in a limit-eycling system, sueh as 
a PIO, is usually approximately sinusoidal (Slotine and Li, 1991:157). 

Any system which can be rearranged into the form shown in Figure 2-1, where w 
and G(p) represent nonlinear and linear elements, respectively, can be studied using 
deseribing functions (Slotine and Li, 1991:162). Examples of nonlinear elements include 
dead-zones, hysteresis or rate saturations. Rate saturations were the foeus of this study. 


r(t) = 0 

7) ^ 

w=f(x) 

w(t) . 

G(P) 

_ vm _ 


\y * 

p 



J 

L 







Figure 2-1. Example of a Nonlinear System 

Eor the basic version of the deseribing function method, the system has to satisfy 
the following four eonditions (Slotine and Li, 1991:164): 
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1) There is only a single nonlinear eomponent 

2) The nonlinear eomponent is time-invariant 

3) Corresponding to a sinusoidal inputx = Asm{a)t ), only the fundamental 
eomponent w\{t) in the output w{t) has to be eonsidered 

4) The nonlinearity is odd 

Consider a sinusoidal input of the form x = Asm{(X>t) entering the nonlinear 
element of the system shown in Figure 2-1. Due to nonlinear effeets, the output, w{t), is 
“often a periodie though non-sinusoidal funetion” (Slotine and Li, 1991:165). The output 
funetion w{i) ean be expanded using Fourier series as seen in Equation 1 and the 
sueeeeding derivation (Slotine and Li, 1991:165): 


where 


w{t) = — + ^[«„ cos(not) + smincot)] 

2 n=\ 

(1) 

1 ^ 

ag = — [ w{t)d{a)t) 
n •' 

(2) 

-K 

1 ^ 

a^=—\ w{t)co?,{n<x>t)d{o)t) 
n •' 

(3) 

-71 

1 % 

b^= — \ w{t)smina)t)d{a)t) 
n •' 

(4) 


Applying eondition four above, for all odd funetions Og = 0 (Slotine and Li, 
1991:166). Lurther, applying the third assumption means disearding all other terms 
exeeptn = l (Slotine and Li, 1991:166). This leaves: 

w{t) « Wj {t) - cos{a)t) + hj sin(ot) (5) 
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which can be rewritten as 


Wi (t) = M sm{a)t + (j)) (6) 

where 

M = (7) 

f \ 

(f) = tan ' — (8) 

Rewritten in eomplex notation leads to: 

Wj (0 = = (hi + ja, (9) 

Finally, the describing function, N{A,o )), is defined to be the complex ratio of 
the fundamental eomponent of the nonlinear element to the input sinusoid. This is shown 
in Equation 10: 

N{A,(o)= =—e^^=-{b,+ja,) (10) 

Saturation Nonlinearity Describing Function 

Now consider the saturation input-output relationship shown in Figure 2-2 below: 



Figure 2-2. Saturation Nonlinearity and the Corresponding Input-Output Relationship 

(Slotine and Fi, 1995:173) 
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From the figure, it is apparent that if our input, x{t) = y4sin(ot) , has a maximum 
amplitude A <a then the input remains linear and the output is just w(t) = kAsm(cot). But 
if the maximum amplitude. A, is greater than a, elipping oeeurs and the value of w(t) can 
be split into two sets over the first quarter of the symmetrie output (Slotine and Li, 
1995:173): 


wit) = 


f kA sin(®t) 
[ka 


0<cot</ 

Y < cot < ^ 


( 11 ) 


where y = sm'^{a/A) 

The output w{t) is an odd funetion, implying aj = 0 in Equation 5. Further, 
dividing the output into four quarters yields a new equation for b\ 


bi = 



w{t)?,m{(i>t)d{(i>t) 


( 12 ) 


4 ^ 4/2 

b^= — \kA sin^ {o)t)d{cot) — \ ka ?,m{cot)d{cot) (13) 

J TT J 


n 




2kA 


n 


a , a 


( 14 ) 


Substituting aj = 0 and Equation 14 into Equation 10 leaves (Slotine and Ei, 1995:174): 

(15) 


6] 

2k 


1 a 

a i 


= - 

sm 

— + 

— Jl-V 

A 



A 

A\ A^ 


Closed Loop Describing Function Approximation 

Now, consider the block diagram in Figure 2-3 of a first order actuator system and 
the derivations which follow (Klyde and others, 1996:36-46). 
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Figure 2-3. Actuator Model Development (Klyde and others, 1995:22) 


The nonlinear portion of this model is exactly the same as the saturation 
nonlinearity discussed previously. Substituting the appropriate new nomenclature and 
letting e{t) = E sm{(Dt + </)) replace x{t), leads to the following describing function for the 
nonlinear element: 


N{A,a)) = 


2(0,. 


n 


sin ' 


+—1 

Ji-4 


Vej 

E 

V E^ 


(16) 


Further, by using series expansions for both the arcsine term and the square root, the 
describing function can be approximated by: 


N(A,a)) = 


2(o„ 


71 


^ + - 
E 6 






+ ■ 


^ ^ 1 ^ 




(17) 


Keeping only the first order linear terms yields: 

2(0 


N{A,(o) = - 


71 


E E 


71 E 


(18) 


Substituting leads to: 

4 V 

N{A,(o) = -^ 

77 E 


(19) 
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Next, consider the revised block diagram shown in Figure 2-4 and determine the 
closed loop transfer function, treating as a constant. 



Figure 2-4. Closed Loop Actuator Transfer Function Diagram 
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Now, still treating A^as a constant and utilizing standard block diagram transfer 


function techniques, the relationship of S(s) to (s) is: 

^ '^Command 






1 



N 

s + N 


(24) 


and its magnitude is 




S, 


^Command 




Va^ 


^co^+N^ 


and substituting Equation 23 into Equation 25 gives 




S, 


^Command 


(M 


±Il. 

n Aco 


(25) 


(26) 


Solving for the phase angle of Equation 24 yields: 


.(7«) 


^ -co^ 

V A^y 


and substituting Equation 23 yields 




SeijGJi) 

.(7®) 


= - tan ' 


^n Act)^ 


v4 


-1 


(27) 


(28) 


Sinusoidal Input/Triangle Output Describing Function Approximation 

Another describing function approximation can be made by utilizing the observed 
characteristics of a saturated actuator. The input, x,(t), is sinusoidal in nature and the 
output, xoftj, takes on the familiar saw tooth triangle shape as shown in Eig 2-5 (Klyde 
and others, 1995:42-46): 
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Figure 2-5. Rate-Limiting Input and Output (Klyde and others, 1995:42-46) 


As before, let the input be sinusoidal as shown in Equation 29: 

x.{t) = x. sin((yt) 

^ ‘max 

and the derivative or input rate is: 

(0 = A cos((yt) 

‘ ^max 

Now, let (o = InjT where T = 4t.. Then the maximum input rate is 

7t A 

_ max 

X- — 

‘max 2 ^ 

The rate of the output, x ^, is equal to the slope of the output and is given by 


(29) 

(30) 

(31) 


Xo=±^ (32) 

^0 

Now, take the relationship of the output rate to the input rate in the range of to and 
solve for the ratio of output to input magnitude as: 
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( 33 ) 


1 

o 

(x ^ 

/ 

f ^ ^ 

|_Xo 2t. 

X. 

max 

J 

/ 

t, J 

1 

o 


Recognizing to equals ti, rearranging terms and introducing a new variable K * gives: 

-^ = -^ = K* (34) 

X. 2 X. 


Rewriting this expression in terms of the Figure 2-3 variables and recognizing that the 
output rate when saturated is Vl and the maximum input rate is Aw leaves 

71 V 

= (35) 

1 Aw 

The describing function magnitude is then expressed using the K * value multiplied by 
the Fourier fundamental of the triangle wave as seen in Equation 36 (Klyde and others, 
1996:45). 








-\k^ = 

n 


n Aw 


(36) 


This is exactly the same expression derived earlier for the closed loop actuator describing 
function magnitude. To obtain the phase angle of the input/output relationship, the term 
tD as shown in Figure 2-5 must be determined. The input and output amplitudes are equal 
when t = 

= (37) 

Simplifying this expression by substituting if* = x^jx- , expanding sin[(u(6 + to)], and 
substituting wt. = ;r/2 results in (Klyde and others, 1996:45): 

cos(A^zi) = K* (38) 
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where = cot^ is the phase angle between the input and output. Solving for and 


noting that it is a phase lag gives Equation 39: 


-A^ = -cos = 


Se{jG>) 


= - tan 


-1 


M 


-1 


(39) 


Now to eompare with the elosed-loop deseribing function phase angle, substitute 
K* = (^7r/2'j(V^IAco'j into Equation 39, which results in 


^^^^^ = -tan-' 




J 


-1 


(40) 


This is slightly different from the closed loop describing function phase angle expression. 
These phase angle differences are shown as a function of K*m Eigure 2-6: 



Eigure 2-6. Describing Eunction Phase Angle Comparison 
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These two describing function approximations were introduced to show that 
similar results can be derived from different methods. According to Klyde, the more 
accurate of these two describing function approximations for application to Category II 
PIO is the sinusoidal input/triangle output solution (Klyde and others, 1996:46). 
Therefore, this describing function will be used throughout the remainder of this study. 
Applying Describing Function Results to Predict PIO 

Consider the longitudinal closed-loop system shown in Figure 2-7. Gp{s) 

represents a model of the pilot and Gc (s) represents a model of the bare aircraft 
dynamics. The remaining elements are equivalent to the rate-limited actuator model 
previously discussed in Figure 2-3. 



Figure 2-7. Pitch Tracking Closed Loop System 

The linear elements G^is) and can be combined into one linear element, 
G(s) and the nonlinear element, N(A,co ), remains separate as shown in Figure 2-8. 
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Figure 2-8. Simplified Pitch Tracking Closed Loop System 
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This model can then be applied to a limit cycle analysis. The requirement for a 
neutrally damped oscillation is simply that the open-loop amplitude ratio be equal to 1.0 
and the phase be -180“ (Klyde and others, 1996:54). In order for a PIO to persist, the 
system shown in Fig 2-8 must satisfy the Nyquist criteria shown in the following 
equation (Klyde and others, 1996:54): 

G{jQ})N{Q},A) = -\ (41) 


or rearranged 


G{jco) = 


-1 

N{q},A) 


(42) 


The easiest way to view the application of this equation is to plot the open-loop 
magnitude and phase values of the negative inverse describing function, -\lN{j<i), A ), 
using the K * solutions from Equations 36 and 39 as well as the open-loop magnitude 
and phase of G(jco). If the two plots intersect, a PIO is predicted (Klyde and others. 


1996:63). This will be shown by means of an example later in this chapter. The K * 
solutions for the negative inverse describing function are shown below in Equations 43 
and 44 (Eiebst, 2002): 


-1 

N(K*) 


= -20Eogio 



(dB) 


(43) 


^-^ = —cos'(K*)-180 (deg) (44) 
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Pilot Model 


There are many pilot models to choose from in the literature. Some believe that a 
simple gain with no phase lag best represents the pilot in the PIO situation (Klyde and 
others, 1996:54). Others believe structural models are better predictors (Mitchell and 
Klyde, 1998:426). In another recent study, the Neal-Smith pilot model was judged to 
best represent the pilot model prior to the onset of rate limiting (Gilbreath, 2001:7-3). 
Therefore, in this study, the Neal-Smith pilot model will be utilized. 

The Neal-Smith pilot model is useful for pilot-aircraft pitch attitude control loops 
with unity-feedback and has the following characteristics (MIL-HDBK-1797, 1997:237): 

1. Adjustable gain 

2. Time delay 

3. Ability to develop lead, or to operate on derivative or rate information 

4. Ability to develop lag, or to smooth inputs 

5. Ability to provide low-frequency integration 

The Neal-Smith pilot model can take on one of two forms. This determination is 
based on the whether constant speed or two-degree-of-freedom equations are used to 
represent the bare aircraft dynamics. These are typified by noting whether or not a free 
integrator is contained in the denominator of the aircraft pitch transfer function. 
Otherwise, three-degree-of-freedom equations or flight control system utilizing attitude 
stabilization will require a different form. Table 2-1 shows these two transfer functions 
for the Neal-Smith pilot model (MIL-HDBK-1797, 1997:237; Bailey and BidLack, 
1995:8). 
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Table 2-1. Neal-Smith Pilot Models 


Aircraft Transfer Function 
with a Free Integrator 

Aircraft Transfer Function 
without a Free Integrator 

-0.25s 



The theory states that the pilot ehooses his gain, , and his lead/lag time 

eonstants, Tiead and Tiag, to attain a certain bandwidth. This bandwidth varies with the 
flight phase category. For example, for Category A flight phase maneuvers such as air- 
to-air dogfighting, the required bandwidth is 3.5 rad/sec. This is measured at a closed- 
loop phase of-90 degrees. Further, the pilot adjusts , Jfearfand Tiag to minimize droop 

to no greater than 3 dB for Level 1 performance and no greater than 9 dB for Level 2 
over the frequency range from 0 to 10 rad/sec while at the same time minimizing closed 
loop resonance (MlL-HDBK-1797, 1997:239). The phase lag term, represents 
delays in the pilot’s neuromuscular system (MlL-HDBK-1797, 1997:239). A graphical 
depiction of these pilot efforts can be seen in Figure 2-9. 
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Phase (deg) Magnitude (dB) 


Closed Loop Bode Diagram 



Figure 2-9. Neal-Smith Pilot Model Constraints 
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Gap Criterion 

Utilizing the previous theoretieal developments, a systematie proeess relating 
aircraft plant dynamics and actuator rate limits to PIO tendency rating will be introduced. 
The procedure is called the Gap Criterion and is based on the block diagram shown in 
Figure 2-10: 



Figure 2-10. Pitch Tracking Closed-Loop System for Gap Criterion 

In modern fly-by-wire aircraft, feedback is an integral part of obtaining more 
desirable closed loop flying qualities. However, as mentioned earlier, rate limiting 
exposes the unaugmented dynamics and adds phase lag (Hanley, 2003:1-3). A pilot 
suddenly faced with different flying qualities will not be able to adjust his gain, lead or 
lag properties instantaneously. He will therefore continue to fly in such a manner as if 
the augmented aircraft dynamics were still in place. Therefore, the term Gijco) from 
Equation 42 is the product of the bare aircraft dynamics, Gc(5), convolved with the Neal- 
Smith pilot model, G^{s). This idea is incorporated in the derivation of the Gap 
Criterion. 

When rate limiting is not occurring, the actuator dynamics from Figure 2-10 can 
be determined from block diagram methods and is G actuator = co^ji^s + co^Y 
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Gap Criterion Formulation. 

Computing the Gap Criterion consists of the following steps: 

1. Determine the bare aircraft pitch-to-actuator transfer function, (s) = . 

W 

2. If the short period poles of G^{s) are unstable then the Gap Criterion 
automatically equals zero. This is due to control amplitudes approaching 
zero which cause an immediate departure from controlled flight due to 
dynamic instability resulting from actuator rate saturation. 

3. Determine actuator dynamics for the following form: —. 

s + a^ 

Typically, co^ = 20 and this will be used throughout this study (Liebst,2001). 

4. Determine an appropriate optimized Neal-Smith pilot model, G^ ( 5 ), for the 

augmented aircraft dynamics plus actuator dynamics, * Gaugmemed ■ 

5. Plot the open-loop magnitude and phase of the bare aircraft dynamics 
convolved with the Neal-Smith pilot model dynamics, G^{s)^Gp{s) on a 
Nichols chart 

6. Plot the negative inverse describing function open-loop magnitude and phase 
on the same Nichols chart using if * . See Equations 43 and 44. 

7. Determine the resulting type by reference to Figure 2-11 and then compute 
the Gap Criterion by following the steps of that type. 
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Figure 2-11. Four Resulting Gap Criterion Types 
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Typel. 


1-1. Determine the minimum amount by which the pilot would need to 

effectively increase gain, ISK^ (dB), such that the two magnitude-phase 

lines just intersect at a frequency greater than the -3 dB Neal-Smith 
maximum droop frequency as shown in Figure 2-12; 


Nichols Chart 



Figure 2-12. Case 1 Effective Pilot Gain Increase 

1-2. Determine the values of K* and co (rad/sec) at this intersection 
1-3. Determine the commanded actuator deflection amplitude, A, utilizing the 
following equation where Vl is the known actuator rate limit in deg/sec: 

2 coK^ 

1-4. Normalize this amplitude by dividing by the maximum available actuator 
deflection, Amax 

1-5. The Gap Criterion is this normalized amplitude multiplied by AKpi 
Gap Criterion = ^ 
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Type 11. 


2-1. Determine the minimum amount by which the pilot would need to 

effectively decrease gain, IsK^ (dB), such that the two magnitude-phase 

lines only intersect in one place at a frequency greater than the -3 dB Neal- 
Smith maximum droop frequency as shown in Figure 2-13; 


Nichols Chart 



Figure 2-13. Case II Effective Pilot Gain Decrease 

2-2. Determine the values of K* and co (rad/sec) at this intersection 
2-3. Determine the commanded actuator deflection amplitude, A, utilizing the 
following equation where Vl is the known actuator rate limit in deg/sec: 

2 aK* 

2-4. Normalize this amplitude by dividing by the maximum available actuator 
deflection, A^ax 

2-5. The Gap Criterion is this normalized amplitude multiplied by AKp. 

Gap Criterion = ^ 

A 
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Type HI. 


3-1. Determine the values of K* and co (rad/see) at the interseetion 
3-2. Determine the eommanded aetuator defleetion amplitude, A, utilizing the 
following equation where Vl is the known aetuator rate limit in deg/see: 

2 q}K* 

3-3. Normalize this amplitude by dividing by the maximum available aetuator 
defleetion, Amax 

3-4. The Gap Criterion is this normalized amplitude. 

Gap Criterion = - 


Type IV. 

4-1. No determination of Gap Criterion ean be made. 

Example of Gap Criterion Application 

Reeonsider the elosed loop system of Figure 2-10 with the following oharaeteristies: 




GM)- 


(4.5)(5 + 1.5) 
s{^s^ + 35 - 1 - 6 ^ 




20 


5 - 1-20 


k = 0 (unaugmented), therefore G^ 


augmented 


• Fl = 30 deg/see 

• Maximum aetuator defleetion; 5^ =30 deg 

^max 

• Category A flight phase, Neal-Smith bandwidth = 3.5 rad/see 
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Utilizing the USAF Wright Laboratory Flight Dynamics Directorate’s MATLAB™ 
Interactive Flying Qualities Toolbox for Matlab (Domon and Foringer, 1996), the Neal- 
Smith pilot model was found to be; 

Gp(s) = 0.856 + e 

(O.OOOls + 1) 

The open-loop magnitude and phase of are plotted in Figure 2-14 as 

well as the open-loop magnitude and phase of the negative inverse describing function. It 
can be seen that an open-loop gain increase (AAp) of 7.502 dB is required for the two 
lines to meet. At this intersection, the values for A* and co are 0.7635 and 3.9418 rad/sec, 
respectively. After calculating the amplitude, ^4 = 15.66 deg, the result is normalized by 
dividing by 30 deg (5e max)- This normalized result is multiplied by AAp to yield the Gap 
Criterion. In this example the Gap Criterion equals 1.238. 

This example showed how preflight Gap Criterion can be calculated. It is 
expected that matching these values with their respective PIO Tendency Ratings should 
yield some correlation. This will be accomplished by examining historical databases and 
then collecting additional data in the LAMARS simulator and VISTA aircraft. 



Figure 2-14. Nichols Chart of the Example Problem 
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Ill, Analysis of Selected Historical Data 

In this section, two previous PIO studies, HAVE PREVENT and HAVE OEOP, 
will be examined using the Gap Criterion (Hanley, 2002; Gilbreath, 2000). 

HAVE PREVENT Analysis 

HAVE PREVENT was a simulator and flight test study comparing two different 
PIO prevention filters. The study was conducted as part of a Test Management Project at 
the USAF Test Pilot School and a thesis sponsored by the Air Force Institute of 
Technology (Hanley and others, 2002; Hanley, 2003). The two PIO filters examined 
were the Feedback with Bypass and the Derivative Switching filters. In order to establish 
a baseline, runs with neither filter engaged were conducted in both the EAMARS 
simulator and VISTA NF-16D aircraft. However, few no-filter data points were collected 
during the flight test portion. Therefore, only the simulator data will be examined. 

In this simulator, pilot-induced oscillation tendency ratings (PIOR) were gathered 
in two distinct phases with specific piloting tasks and in which the evaluation pilot was 
blind to the randomized bare aircraft dynamics and rate limit combinations. In Handling 
Qualities Phase 2 testing, a precision aimpoint was tracked as “aggressively and 
assiduously as possible, always striving to correct even the smallest errors” using a 
piloting technique known as Handling Qualities During Tracking (HQDT) (Brown and 
others, 2002:21-18). The precision aimpoint involved a sum-of-sines head’s up display 
(HUD) tracking task, as shown in Figure 3-1 (MIE-HDBK-1797, 1997:108m). Handling 
Qualities Phase 3 “operational” testing was also accomplished and involved two different 
tasks (Brown and others, 2002:21-19). These tasks were the discrete HUD pitch tracking 
task and computer generated aircraft target tracking task shown in Figures 3-2 and 3-3. 
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Sum of Sines Pitch Tracking Task 



Figure 3-1. Phase 2 Sum-of-sines Pitch Tracking Task 




Figure 3-2. Phase 3 Discrete FIUD Pitch Tracking Task 
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Figure 3-3. Phase 3 Target Traeking Task 

The study involved four test eases labeled A through D. Eaeh test ease had 
different bare aireraft dynamies but all were augmented with angle-of-attaek and piteh- 
rate feedbaek to produee almost identieal elosed loop dynamies. Table 3-1 shows these 
dynamies and the augmentation required. Also shown are the bare and augmented short 
period natural frequeneies (cOsp) and damping ratios (^sp) for eaeh ease exeept for Case D 
whieh is unstable. The time to double amplitude (T 2 ) is shown instead. The aetuator rate 
limits used in this projeet were 15 deg/see, 30 deg/see, 45 deg/see and 60 deg/see. The 
Matlab/Simulink™ diagram used to determine the bare and augmented aireraft transfer 
funetions is shown in Figure 3-4. Appendix A eontains the fourth order state spaee 
model matriees of the linear deeoupled small perturbation longitudinal equations of 
motion. 

_ Table 3-1. FIAVE PREVENT Case Charaeteristies (Hanley, 2003) _ 


Case 

Bare Aireraft 
Poles 

®sp 

Csp 

K. 

K„ 

Aireraft Poles with 
Stability Augmentation 

A 

-0.017 ±0.074j 
-2.200 ± 2.220j 

3.125 

0.704 

0 

0 

-0.017 ±0.074j 
-2.200 ± 2.220j 

B 

-0.016 ±0.079j 
-1.420 ± 1.860j 

2.34 

0.61 

0.14 

0.21 

-0.0166 ±0.0736j 
-2.261 ±2.359j 

C 

-0.009 ± 0.097j 
-0.860 ± 0.084j 

0.86 

0.995 

0.24 

0.51 

-0.0168 ±0.0737j 
-2.241 ±2.517j 

D 

-0.017 ±0.033j 
1.07,-1.67 

T 2 = 2.31 see 

0.34 

0.61 

-0.0169 ±0.0737j 
-2.317 ±2.624j 


3-3 




Figure 3-4. Longitudinal State Space Diagram (Matlab/Simulink™, 2001) 


Gap Criterion Calculation for HAVE PREVENT Datasets. 

Step 1. 

The pitch-to-actuator transfer functions for the bare aircraft dynamics are shown 
in Table 3-2. They were calculated using the Matlab™ code shown in Appendix B. 


Table 3-2. FIAVE PREVENT Pitch-to-Actuator Transfer Eunctions {G^) 


Case 

G. 

A 

-11.095^-14.375-0.5277 

5^+4.4025' +9.8895^ +0.35625 + 0.05612 

B 

-11.095^-14.375-0.5277 
5^2.8875^5.5735^0.19385 + 0.03557 

C 

- 11 . 095 "-14.375-0.5277 

5 ^ + 1 . 7295 " + 0 . 77995 " +0.029555 + 0.007019 

D 

-II.O 85 "- 14 . 375 - 0.5277 

5 " + 0 . 6345 " -1.7655" - 0.059935 - 0.002462 


Step 2. 

Since Case D has unstable short period poles, the Gap Criterion is automatically 
set equal to zero for all rate limits. 
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Step 3. 


Actuator dynamics for this dataset are = -. 

5 + 20 

Step 4. 

The Neal-Smith pilot model transfer funetions are shown in Table 3-3 along with 
the augmented dynamics for which they were computed. They were calculated using the 
Interaetive Flying Qualities Toolbox for Matlab provided by the Flying Dynamies 
Directorate of the Air Force Research Laboratories (Doman and Forringer, 1996). 


Table 3-3. HAVE PREVEN1 

" Neal-Smith Pilot Models 

Case 


'^actuator '^augmented 

A 

(55 + 1) (0.316595 + 1) 

0.12533^ tg-0.25. 

5 (0.00015 + 1) 

-221.75^-287.55-10.55 

5^ +24.45^97.935^ +198.15^7.1795 + 1.122 

B 

(55 + 1) (0.283365 + 1) 

0.12652'^ tg-0.25. 

5 (0.00015 + 1) 

-221.75^-287.55-10.55 

5 ' +22.895^94.575^198.85^ +7.0185 + 1.114 

C 

(55 + 1) (0.254335 + 1) 
0.12618^ 

5 (0.00015 + 1) 

-221.75^-287.55-10.55 

5 '+ 21 . 735 "+89.115'+ 198 . 65 "+7.0885 + 1.118 

D 

(55 + 1) (0.231825 + 1) 
0.12659^ 

5 (0.00015 + 1) 

- 221 . 75 "-287.55-10.55 

5 ' + 20 . 635 " + 86 . 935 ' +198.75" +7.125 + 1.12 


Step 5 and 6. 

Figure 3-5 shows the Nichols charts for Cases A, B and C. 
Step 7. 

Cases A and B are of Type I. Case C is Type III. 
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Nichois Chart 



Nichols Chart Nichols Chart 




Figure 3-5. HAVE PREVENT Nichols Charts for Cases A, B and C 


Type I, Step 1-1 through 1-2. 

The minimum amount of effective increase in gain for Cases A and B, along with 
the determined values for K*, ro and Amax, are shown in Table 3-4: 


Table 3-4. HAVE PREVENT Components for Cases A and B 


Case 


K* 

(u(rad/s) 

^max (deg) 

Case A 

8.431 

0.829 

4.51 

30 

Case B 

3.159 

0.726 

2.80 

30 


The final values for the Gap Criterion and amplitude for each case and rate limit 
are shown in Table 3-5: 
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Table 3-5. Gap Criteria Values for HAVE ; 

PREVENT Cases A and B 

Case 

Maximum Actuator 
Deflection Rate (Vl, deg/sec) 

A (deg) 

Gap 

Criterion 

A 

15 

6.302 

0.555 

30 

12.604 

1.109 

45 

18.906 

1.664 

60 

25.208 

2.218 

B 

15 

11.591 

0.556 

30 

23.182 

1.112 

45 

34.773 

1.667 

60 

46.364 

2.223 


Type HI, Step 3-1 through 3-4. 

The determined values for K*, ©, A^ax and Gap Criterion for each rate limit 
applied to Case C are shown in Table 3-6: 


Table 3-6. Gap Criteria for HAVE PREVENT Case C 


Case 

K* 

(u(rad/s) 

Amax (deg) 

Maximum Actuator Deflection 
Rate (Vl, deg/sec) 

H(deg) 

Gap 

Criterion 





15 

9.002 

0.300 

C 

0.999 

2.62 

30 

30 

18.004 

0.600 

45 

27.006 

0.900 





60 

36.008 

1.200 


HAVE PREVENT Gap Criterion Summary, 

Table 3-7 summarizes the Gap Criteria for Project HAVE PREVENT. The 
dataset produced a range of Gap Criterion from 0.0 to 2.233. The range was well 
distributed for attempting to correlate Gap Criterion and PIOR. 
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Table 3-7. HAVE PREVENT Gap Criteria Summary 


Case 

Maximum Actuator 
Deflection Rate (Vl, deg/sec) 

Gap 

Criterion 

A 

15 

0.555 

30 

1.109 

45 

1.664 

60 

2.218 

B 

15 

0.556 

30 

1.112 

45 

1.667 

60 

2.223 

C 

15 

0.300 

30 

0.600 

45 

0.900 

60 

1.200 

D 

15 

0.0 

30 

0.0 

45 

0.0 

60 

0.0 


HAVE PREVENT Gap Criterion Correlation. 

The PIOR and Gap Criterion data were paired and the results plotted in Eigures 3- 
6 through 3-8. There were eases in whieh the same bare aireraft dynamics and rate limts 
and hence the same Gap Criterion value were tested multiple times by the same pilot or 
different pilots. In these cases, the same PIOR was often found. This resulted in multiple 
pairs of datapoints with the same Gap Criterion and PIOR vaules. In an effort to 
represent this data density, all plots will use a “bubble chart” style in which bubble size 
indicates multiple datapoints with the same pair values. 
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PIO Tendency Rating PIO Tendency Rating 



o 

o 

O 


Single Data Point 

Two Data Points 

Three Data Points 

Four Data Points 

Linear Fit 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates; 25-26 September 2003 


Gap Criterion 


Figure 3-6. HAVE PREVENT Phase 2 Sum-of-sines Task EAMARS Data 



O Single Data Point 
Q Two Data Points 
- Linear Fit 


Data Basis: 15K ft PA, 300 KiAS 
Test A/C: LAMARS Simulation 
Acquisition System; Hand Held 
Configuration; Cruise 
Test Dates; 25-26 September 2003 


Gap Criterion 


Eigure 3-7. HAVE PREVENT Phase 3 Diserete HEID Piteh Traeking Task EAMARS 

Data 
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O Single Data Point 
Q Two Data Points 

- Linear Fit 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System; Hand Held 
Configuration; Cruise 
Test Dates; 25-26 September 2003 


Figure 3-8. HAVE PREVENT Phase 3 Target Traeking Task LAMARS Data 


With just a glanee, it is diffieult to see any readily apparent trend in the data 
seatter. Therefore, the probability of a linear eorrelation existing for the data was 
investigated as deseribed in Appendix C (Wheeler and Ganji, 1996:145-147). The linear 
fit depicted on the plots displays this correlation. 

Confidence level was used to determine if a relationship existed between PIOR 
and corresponding Gap Criterion values. Common engineering practices suggest a 
confidence level of 95% represents definitive “real” correlation (Wheeler and Ganji, 
1996:147). A table listing the linear correlation coefficient, minimum correlation 
coefficient for 95% confidence and actual confidence level for each dataset is shown 
below. It can be seen that 2 out of 3 datasets easily met the minimum confidence level. 
The Phase 3 Target Tracking dataset has fewer datapoints than the other two and hence 
will be more sensitive to outliers. 
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Table 3-8. HAVE PREVENT Correlation Confidenee Eevels 


Dataset 

Sample 

Size 

95 % Confidence 
Minimum 
Correlation 

Actual Einear 
Correlation 

Actual 

Confidence Eevel 

Phase 2 
Sum-of-sines 

30 

0.361 

0.585 

99.93% 

Phase 3 Discrete 
Pitch Tracking 

19 

0.456 

0.596 

99.29% 

Phase 3 

Target Tracking 

12 

0.576 

0.394 

79.49% 


HA VE PREVENT Best Curve Fit. 

In the previous seetion, correlation for a linear fit was investigated. This is not 
necessarily the best curve fit. Multiple curve fits were attempted for each dataset 
including exponential, natural logarithmic, polynomial and power series interpolations. 

A least squares method was used to identify the correlation coefficient of each fit using 
commercial software (Microsoft Excel, 2002). The following table lists these correlation 
values. 


Table 3-9. HAVE PREVENT Curve Eit Correlation Values 


Dataset 

Einear 

Exponential 

Eogarithmic 

(Ln(GC+l)) 

2"^ Order 
Polynomial 

Power Series 
(GC+1) 

Phase 2 
Sum-of-sines 

0.585 

0.561 

0.552 

0.593 

0.525 

Phase 3 Discrete 
Pitch Tracking 

0.596 

0.507 

0.672 

0.786 

0.577 

Phase 3 

Target Tracking 

0.394 

0.426 

0.335 

0.468 

0.357 


At first glance, the second order polynomial curve fit gives the best mathematical 
results. But on further inspection, this curve fit does not match well at higher Gap 
Criterion values. The logarithmic (En(GC+l)) seems to be the best case for the 
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combination of high correlation and endpoint matehing. Sinee Gap Criterion (GC) 
values of zero do not work well with natural logarithmie eurve fits, a faetor of one was 
added to these values and the eorrelation found. Figures 3-6 through 3-8 show the data 
with this logarithmic curve fit. 



Gap Criterion 


Figure 3-9. HAVE PREVENT Phase 2 Sum-of-sines Task LAMARS Data with 

Logarithmie Curve Lit 
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PIO Tendency Rating 31 PIO Tendency Rating 



0 Single Data Point 


O Two Data Points 


Logarithmic Fit 


Data Basis: 1SK ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 25-26 September 2003 


^ure 3-10. HAVE PREVENT Phase 3 Discrete HEiD Pitch Tracking Task LAMARS 

Data with Logarithmic Curve Lit 



O Single Data Point 


O Two Data Points 


— Logarithmic Fit 


Data Basis: 15K ft PA, 300 KiAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 25-26 September 2003 


Eigure 3-11. HAVE PREVENT Phase 3 Target Tracking Task LAMARS Data with 

Logarithmic Curve Lit 
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HAVE OLOP Analysis 

HAVE OLOP was a flight test study attempting to validate the Open Loop Onset 
Point (OLOP) eriteria for PIO predietion. The study was eondueted in the VISTA NL- 
16D as part of a Test Management Projeet at the USAL Test Pilot Sehool and a thesis 
sponsored by the Air Loree Institute of Teehnology (Gilbreath and others, 2000; 
Gilbreath, 2001). Just as in Projeet HAVE PREVENT, PIOR were gathered in two 
distinet phases with speeifie piloting tasks. In faet, with the exeeption of the Phase 3 
Target Traeking Task whieh was not performed, the tasks were identieal to those of 
HAVE PREVENT; Phase 2 Sum-of-sines Traeking Task and Phase 3 Diserete HEID 
Piteh Traeking Task. The PIOR seale used was the same one previously deseribed in 
Chapter I. 

This study also involved four test eases labeled A through D though eaeh was 
distinetly different from the identieally named HAVE PREVENT eases. Eaeh test ease 
had different bare aireraft dynamies but all were augmented with angle-of-attaek and 
piteh-rate feedbaek to produee almost identieal elosed loop dynamies. Table 3-10 shows 
these dynamies and the augmentation required. Also shown are the bare and augmented 
short period natural frequeneies (cOsp) and damping ratios (^sp) for eaeh ease exeept for 
Case D whieh is unstable and diverges. Instead, the time to double amplitude (T 2 ) is 
shown. The aetuator rate limits used in this projeet were 10 deg/see, 20 deg/see, 30 
deg/see, 40 deg/see, 50 deg/see and 60 deg/see. The Matlab/Simulink™ diagram used to 
determine the bare and augmented aireraft transfer funetions is shown in Eigure 3-4. 
Appendix A eontains the fourth order state spaee model matriees of the linear deeoupled 
small perturbation longitudinal equations of motion. 


3-14 



Table 3-10. HAVE OLOl 

P Case Cl 

haraeteristies (Gilbreath, 2001) 

Case 

Bare Aireraft 
Poles 

®sp 

Csp 

K, 

K„ 

Aireraft Poles with 
Stability Augmentation 

A 

-.017±.074j 

-.510±3.36j 

3.40 

0.15 

0.023 

0.412 

-.017±.060j 

-3.51±-3.58j 

B 

-.017±.074j 

-.608±.488j 

0.78 

0.78 

0.444 

0.984 

-.017±.072j 

-3.50±3.58j 

C 

-.017±.074j 

-1.29±1.72j 

2.15 

0.60 

0.897 

0.347 

-.017±.074j 

-3.50±3.57j 

D 

-.017±.074j 
1.284, -2.13 

T 2 = 0.6sec 

1.218 

0.487 

-.017±.074j 

-3.55±3.62j 


Gap Criterion Calculation for HAVE OLOP Datasets. 
Step 1. 

The bare aireraft dynamies are shown in Table 3-11; 


Table 3-11. HAVE OLOP Piteh-to-Aetuator Transfer Funetions {G^) 


Case 


A 

-11.08/-14.375-0.5277 

5 " +1. 0545 ' +11. 6 O 5 " + 0.39895 + 0.06664 

B 

- 11 . 095 "-14.375-0.5277 

5 " +1.25 15 " + 0 . 65555 " + 0.02775 + 0.003507 

C 

-II.O 85 "- 14 . 375 - 0.5277 

5 " + 2 . 6 I 45 " + 4 . 7 I 65 " + 0.1725 + 0.02665 

D 

-II.O 85 "- 14 . 375 - 0.5277 

5 " + 0 . 885 " - 2 . 75 " -0.088115-0.01577 


Step 2. 

Sinee Case D has unstable short period poles, the Gap Criterion is automatieally 
set equal to zero for all rate limits. 
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Step 3. 


Actuator dynamics for this dataset are = -. 

5 + 20 

Step 4. 

The Neal-Smith pilot model transfer functions are shown in Table 3-12 along with 
the augmented dynamies for whieh they were eomputed: They were ealeulated using the 
Interactive Flying Qualities Toolbox for Matlab (Doman and Porringer, 1996). 


Table 3-12. HAVE OLOP Neal-Smith Pilot Models 


Case 


'^actuator '^augmented 

A 

(55 + 1) (0.075435 + 1) 

0.23108'^ Ig-0.25. 

5 (0.00015+ 1) 

-221.75^-287.55-10.55 

5 ' + 2 I.O 55 V 124 .I 5 ' +356.05^ +12.575 + 1.377 

B 

(55 + 1) (0.0743315 + 1) 
0.23398 ^ ^ \ 

5 (0.00015+ 1) 

-221.75^-287.55-10.55 

5 ' + 2 I. 255 V 125 . 25 ' +360.75^12.885 + 1.956 

C 

(55 + 1) (0.0688215 + 1) 
0.25267 ^ ^ V / 

5 (0.00015+1) 

-221.75^-287.55-10.55 

5 ' + 22 . 6 I 5 V 134.95^ + 394.85 V14 .15 + 2.253 

D 

(55 + 1) (0.0726225 + 1) 

0.23213^ Ig-0.25. 

5 (0.00015+ 1) 

-221.75^-287.55-10.55 

5 ' + 2 O. 885 V 124 .I 5 ' + 357 . 95 V 12 . 8 I 5 + 2 .OI 8 


Step 5 and 6. 

Figure 3-12 shows the Nichols charts for Cases A, B and C: 
Step 7. 

Cases A and C are of Type II. Case B is Type IV. 
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Nichols Chart 



Nichols Chart 


Nichols Chart 




Figure 3-12. FIAVE OLOP Nichols Charts for Cases A, B and C 


Type II, Step 2-1 through 2-2. 

The minimum amount of effective decrease in gain for Cases A and C, along with 
the determined values for K*, ro and Amax, are shown in Table 3-13; 


Table 3- 

3. FIAVE OLOP Components for Cases A and C 

Case 


K* 

(u(rad/s) 

■^max 

Case A 

-10.290 

0.943 

3.50 

30 

CaseC 

-5.455 

0.801 

2.05 

30 
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The final values for the Gap Criteria and amplitudes for Cases A and C and their 


respeetive rate limits are shown in Table 3-14: 


Table 3-14. Gap Criteria Values for HAVE OLOP Case A and C 


Case 

Maximum Actuator 
Deflection Rate (Vl, deg/sec) 

A (deg) 

Gap 

Criterion 

A 

10 

4.76 

0.0485 

20 

9.52 

0.0970 

30 

14.28 

0.1456 

40 

19.04 

0.1941 

50 

23.80 

0.2426 

60 

28.55 

0.2911 

C 

10 

9.57 

0.1702 

20 

19.13 

0.3403 

30 

28.70 

0.5105 

40 

38.26 

0.6806 

50 

47.83 

0.8508 

60 

57.40 

1.0210 


Type IV, Step 4-1. 

HAVE OEOP Case B is a Type IV and has no Gap Criterion solution. 
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HAVE OLOP Gap Criterion Summary. 


Table 3-15 summarizes the Gap Criteria for Project HAVE OLOP; 


Table 3-15. HAVE OLOP Gap Criteria Summary 


Case 

Maximum Actuator 
Deflection Rate (Vl, deg/sec) 

Gap 

Criterion 

A 

10 

0.0485 

20 

0.0970 

30 

0.1456 

40 

0.1941 

50 

0.2426 

60 

0.2911 

C 

10 

0.1702 

20 

0.3403 

30 

0.5105 

40 

0.6806 

50 

0.8508 

60 

1.0210 

D 

10 

0.0 

20 

0.0 

30 

0.0 

40 

0.0 

50 

0.0 

60 

0.0 


HAVE OLOP Gap Criterion Correlation. 

The PIOR and Gap Criterion data were paired and the results plotted in Eigures 3- 
13 and 3-14: 
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PIO Tendency Rating PIO Tendency Rating 



o 

Single Data Point 

o 

Two Data Points 

o 

Three Data Points 

O 

Four Data Points 

O 

Five Data Points 

O 

Sixteen Data Points 


-Linear Fit 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: NF-16D -# 86-00048 
Acquisition System: Hand Held 
Configuration; Cruise/VSS Engaged 
Test Dates: 3-16 October 2003 


Figure 3-13. HAVE OLOP Phase 2 Sum-of-sines Task VISTA Data 



Gap Criterion 


Figure 3-14. HAVE OEOP Phase 3 Diserete HUD Piteh Tracking Task VISTA Data 
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As in the HAVE PREVENT data analysis, the probability of a linear eorrelation 
existing was investigated as deseribed in Appendix C. The linear fit depieted on the plots 
displays this eorrelation. 

Confidenee level was used to determine if a relationship existed between PIOR 
and eorresponding Gap Criterion values with a eonfidenee level of 95% representing 
definitive “real” eorrelation (Wheeler and Ganji, 1996:147). A table listing the linear 
eorrelation eoeffieient, minimum eorrelation eoeffieient and eonfidenee level for eaeh 
dataset is shown below. It ean be seen that both datasets easily met the “real” eonfidenee 
level. 


Table 3-16. HAVE OEOP Correlation Confidenee Levels 


Dataset 

Sample 

Size 

95 % Confidence 
Minimum 
Correlation 

Actual Linear 
Correlation 

Actual 

Confidence Level 

Phase 2 
Sum-of-sines 

72 

0.232 

0.477 

99.99% 

Phase 3 Discrete 
Pitch Tracking 

77 

0.224 

0.460 

99.99% 


HA VE OLOP Best Curve Fit. 

In the previous seetion, eorrelation for a linear fit was investigated. This is not 
neeessarily the best eurve fit. As in the HAVE PREVENT data analysis, multiple eurve 
fits were attempted for eaeh dataset including exponential, natural logarithmic, 
polynomial and power series interpolations. A least squares method was used to identify 
the correlation coefficient of each fit as calculated for the HAVE PREVENT data. The 
following table lists these correlation values: 
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Table 3-17. HAVE OLOP Curve Fit Correlation Values 


Dataset 

Einear 

Exponential 

Eogarithmie 

(Ln(GC+l)) 

2"^ Order 
Polynomial 

Power Series 
(GC+1) 

Phase 2 
Sum-of-sines 

0.477 

0.463 

0.495 

0.507 

0.479 

Phase 3 Diserete 
Piteh Traeking 

0.460 

0.444 

0.493 

0.560 

0.472 


Again, the seeond order polynomial eurve fit gives the best mathematieal results. 
But on further inspeetion, this eurve fit still does not mateh well at higher Gap Criterion 
values. The natural logarithmie (Ln(GC+l)) seems to be the best ease for the 
eombination of high eorrelation and endpoint matehing. For the same reasons as in the 
HAVE PREVENT eurve fitting, a faetor of one was added to the Gap Criterion values 
and the eorrelation found. Figures 3-15 and 3-16 show the data with this logarithmie 
eurve fit. 
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Data Basis: 15K ft PA, 300 KIAS 
Test A/C: NF-16D - # 86-00048 
Acquisition System; Hand Held 
Configuration; Cruise / VSS Engaged 
Test Dates; 3-16 October 2003 


Figure 3-15. HAVE OLOP Phase 2 Sum-of-sines Task VISTA Data with Logarithmic 

Fit 




Data Basis: 15K ft PA, 300 KIAS 
Test A/C: NF-16D - # 86-00048 
Acquisition System; Hand Held 
Configuration; Cruise/VSS Engaged 
Test Dates: 3-16 October 2003 


Figure 3-16. HAVE OLOP Phase 3 Discrete HUD Pitch Tracking Task VISTA Data 

with Logarithmic Lit 
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HAVE PREVENT and HAVE OLOP Summary 

Each dataset from both studies shows eorrelation. All Phase 2 Sum-of-sines and 
Phase 3 Diserete HUD Piteh Traeking Task datasets had linear eorrelation eonfidenee 
levels better than 99%. The HAVE PREVENT Phase 3 Target Traeking Task dataset had 
the worst eorrelation eonfidenee level, never exeeeding 87.5% for any of the eurve fits. 
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IV Analysis of Project MAX GAP (LAMARS) Data 


Project MAX GAP sought to augment the HAVE PREVENT and HAVE OEOP 
datasets. The same Phase 2 Sum-of-sines Tracking Task, Phase 3 Discrete HEiD Pitch 
Tracking Task and Phase 3 Target Tracking Task described in Chapter III were used in 
the EAMARS simulator. The PIOR scale used was the same one previously described. 

MAX GAP (LAMARS) Analysis 

The study involved one previous test case, Case B from HAVE PREVENT, and 
three new test cases labeled N, W and Y. A series of bare aircraft dynamics with varying 
short-period characteristics were chosen (26 in all). The Gap Criterion was applied to 
each of these. Cases B, N, W and Y were chosen for their Gap Criterion distribution. 

Each test case was augmented with angle-of-attack and pitch-rate feedback which 
produced almost identical closed-loop dynamics. Table 4-1 shows these dynamics and 
the augmentation required. Also shown are the bare and augmented short period natural 
frequencies (cOsp) and damping ratios (^sp) for each case. The actuator rate limits used in 
this project were 15 deg/sec, 30 deg/sec and 60 deg/sec. See Appendix A for the fourth 
order state space model matrices. 


Table 4-1. MAX GAP (LAMARS) Case Characteristics (Witte and others, 2003) 


Case 

Bare Aircraft 
Poles 

®sp 

Csp 

K, 

K„ 

Aircraft Poles with 
Stability Augmentation 

B 

-1.43±1.85j 

-.017±.074j 

2.34 

0.61 

0.156 

0.123 

-2.17±-2.22j 

-.017±.070j 

N 

-.939±2.99j 

-.017±.074j 

3.13 

0.30 

-0.335 

0.177 

-2.18±2.22j 

-.018±.050j 

W 

-4.24±2.05j 

-.017±.074j 

4.71 

0.90 

-0.501 

-0.345 

-2.18±2.24j 

-.017±.081j 

Y 

-2.09±1.01j 

-.017±.074j 

2.32 

0.90 

0.346 

0.0334 

-2.19±2.24j 

-.017±.080j 
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Gap Criterion Calculation for MAX GAP (LAMARS) Datasets. 

Step 1. 

The pitch-to-actuator transfer funetions for the bare aireraft dynamies are shown 
in Table 4-2 and were eomputed using the Matlab^'^ eode in Appendix B. 


Table 4-2. MAX GAP (LAMARS) Piteh-to-Aetuator Transfer Funetions () 


Case 


B 

-11.085^-14.375-0.5277 

5 " +2.8895' +5.5785" +0.20265 + 0.03157 

N 

- 11 . 095 "-14.375-0.5277 

5 " + 1 . 9125 ' + 9 . 8675 " +0.34395 + 0.05648 

W 

- 11 . 095 "-14.375-0.5277 

5 ^ + 8.5 125 ' + 22 . 485 " + 0.803 15 + 0.1279 

Y 

- 11 . 085 "-14.375-0.5277 

5 V 4 . 2 I 5 ' - 5 . 535 " -0.20715-0.03103 


Step 2. 

Does not apply; all four oases have stable poles for their bare aireraft dynamies. 
Step 3. 

Aotuator dynamics for this dataset were . 

s + 20 

Step 4. 

The Neal-Smith pilot model transfer functions are shown in Table 4-3 along with 
the augmented dynamics for which they were computed. They were calculated using the 
Interactive Flying Qualities Toolbox for Matlab provided by the Flying Dynamics 
Directorate of the Air Force Research Laboratories (Doman and Forringer, 1996). 
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Table 4-3. MAX GAP (LAMARS) Neal-Smith Pilot Models 


Case 


^actuator '^augmented 

B 

(55 + 1) (0.326995 + 1) 

0.11483^ ^^-0.25, 

5 (0.00015 + 1) 

-221.75^-287.55-10.55 

5' +22.895^90.885' +182.15^6.5975 + 0.9303 

N 

(55 + 1) (0.326995 + 1) 

0.10919^ ^g-0.25. 

5 (0.00015 + 1) 

-221.75'-287.55-10.55 

5 ' +2I.9I5" + 86.895' +173.25' +6.1865 + 0.4845 

W 

(55 + 1) (0.303115 + 1) 

0.15254'^ ^g-0.25. 

5 (0.00015+1) 

-221.75'-287.55-10.55 

5 ' +28.515VII6.35'+239.75'+8.6815 + 1.596 

Y 

(55 + 1) (0.313185 + 1) 

0.12528'^ ^^-0.25. 

5 (0.00015 + 1) 

-221.75'-287.55-10.55 

5 ' +24.2I5V 97.55' +197.95' +7.2185 + 1.286 


Step 5 and 6. 

Figure 4-1 shows the Nichols charts for Cases B, N, W and Y: 


Nichols Chart 



Case B 


Nichols Chart 



Case N 


Nichols Chart 


Nichols Chart 




Figure 4-1. MAX GAP (LAMARS) Nichols Charts for Cases B, N, W and Y 
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Step 7. 

Cases B, N, W and Y are all of Type I. 

Type I, Step 1-1 through 1-2. 

The minimum amount of effeetive inerease in gain for Cases B, N, W and Y, 
along with the determined values for K*, 0 and Amax, are shown in Table 4-4. The final 
values for the Gap Criterion and amplitude for eaeh ease and rate limit are shown in 
Table 4-5 


Ta ble 4-4, MAX GAP (LAMARS) Components for Cases B, N, W and Y 


Case 


K* 

(u(rad/s) 

A max 

Case B 

4.065 

0.719 

2.93 

30 

Case N 

1.661 

0.806 

3.70 

30 

Case W 

12.450 

0.955 

7.07 

30 

Case Y 

7.230 

0.664 

2.95 

30 


Tabl e 4-5. Gap Criteria Values for MAX GAP (LAMARS) Cases B, N, W a nd Y 


Case 

Maximum Aetuator 
Defleetion Rate (Vl, deg/see) 

A (deg) 

Gap 

Criterion 

B 

15 

11.18 

0.5953 

30 

22.37 

1.1907 

60 

44.72 

2.3814 

N 

15 

7.90 

0.3189 

30 

15.80 

0.6377 

60 

31.60 

1.2754 

W 

15 

3.49 

0.4880 

30 

6.98 

0.9760 

60 

13.95 

1.9520 

Y 

15 

12.03 

0.9276 

30 

24.06 

1.8552 

60 

48.12 

3.7104 
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MAX GAP (LAMARS) Gap Criterion Summary. 


Table 4-6 summarizes the LAMARS Gap Criteria for Projeet MAX GAP: 


able 4-6. MAX GAP (LAMARS) Gap Criteria Summary 


Case 

Maximum Actuator 
Deflection Rate (Vl, deg/sec) 

Gap 

Criterion 

B 

15 

0.5953 

30 

1.1907 

60 

2.3814 

N 

15 

0.3189 

30 

0.6377 

60 

1.2754 

W 

15 

0.4880 

30 

0.9760 

60 

1.9520 

Y 

15 

0.9276 

30 

1.8552 

60 

3.7104 


MAX GAP (LAMARS) Gap Criterion Correlation. 

The MAX GAP test team recognized that some outlier datapoints were included 
in the LAMARS datasets. In these cases, poor pilot recognition of PIO cues such as 
aircraft lag response had resulted in improper PIOR assessment. Post-test analysis 
revealed these datapoints which were then omitted from the “reduced dataset” findings 
(Witte and others, 2003:8). These reduced LAMARS datasets were used for this study. 

The remaining PIOR and Gap Criterion data were paired and the results plotted in 
Figures 4-2 through 4-4: 
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PIO Tendency Rating PIO Tendency Rating 



O 

o 

o 

O 



Single Data Point 
Two Data Points 

Three Data Points 

Four Data Points 

Five Data Points 

Six Data Points 
Eight Data Points 
Linear Fit 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 


Gap Criterion 


Figure 4-2. MAX GAP (LAMARS) Phase 2 Sum-of-sines Task Data 



a 

Single Data Points 

O 

Two Data Points 

o 

Three Data Points 

O 

Four Data Points 

— 

Linear Fit 


Data Basis: 15KftPA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 


Gap Criterion 


Figure 4-3. MAX GAP (LAMARS) Phase 3 Diserete HUD Piteh Traeking Task Data 
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Gap Criterion 


o 

Single Data Point 

O 

Two Data Points 

o 

Three Data Points 

o 

Four Data Points 

— 

Linear Fit 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 


Figure 4-4. MAX GAP (LAMARS) Phase 3 Target Traeking Task Data 


As in the HAVE PREVENT and HAVE OEOP data analyses, the probability of a 
linear eorrelation existing for the data was investigated and is deseribed in Appendix C. 
The linear fit depieted on the plots displays this eorrelation. 

Again, eonfidenee level was used to determine if a relationship existed between 
PIOR and eorresponding Gap Criterion values with a eonfidenee level of 95% 
representing definitive “real” eorrelation (Wheeler and Ganji, 1996:147). A table listing 
the linear eorrelation eoeffieient, minimum eorrelation eoeffioient and eonfidenee level 
for eaeh the datasets of the LAMARS portion of Projeet MAX GAP is shown below, ft 
ean be seen that all three datasets exeeeded the neeessary eonfidenee level. 
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Table 4-7. MAX GAP (LAMARS) Correlation Confidenee Levels 


Dataset 

Sample 

Size 

95 % Confidence 
Minimum 
Correlation 

Actual Einear 
Correlation 

Actual 

Confidence Eevel 

Phase 2 
Sum-of-sines 

60 

0.254 

0.581 

99.99% 

Phase 3 Discrete 
Pitch Tracking 

47 

0.288 

0.501 

99.97% 

Phase 3 

Target Tracking 

44 

0.297 

0.469 

99.87% 


MAX GAP (LAMARS) Best Curve Fit. 

In the previous section, correlation for a linear fit was investigated. This is not 
necessarily the best curve fit. Multiple curve fits were attempted for each dataset 
including exponential, natural logarithmic, polynomial and power series interpolations 
just as in the HAVE PREVENT and HAVE OEOP data analyses. A least squares method 
was used to identify the correlation coefficient of each fit. Table 4-9 lists these 
correlation values: 


Table 4-8. MAX GAP (LAMARS) 

1 Curve Eit Correl 

[ation Values 

Dataset 

Linear 

Exponential 

Eogarithmic 

2"^ Order 
Polynomial 

Power Series 

Phase 2 
Sum-of-sines 

0.581 

0.580 

0.573 

0.587 

0.564 

Phase 3 Discrete 
Pitch Tracking 

0.501 

0.481 

0.507 

0.516 

0.487 

Phase 3 

Target Tracking 

0.469 

0.485 

0.482 

0.482 

0.489 


Again, the second order polynomial curve fit gives the best mathematical results. 
But this curve fit still does not match well at higher Gap Criterion values. Just as in the 
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HAVE PREVENT and HAVE OEOP analyses, the natural logarithmie eurve fit seems to 
be the best ease for the eombination of high eorrelation and endpoint matehing. There 
were no Gap Criterion values of zero in this analysis and therefore simple natural 
logarithmie eurve fitting was aeeomplished. Eigures 4-5 and 4-6 show the data with this 
logarithmie eurve fit. 



0 

Single Data Point 

O 

Two Data Points 

o 

Three Data Points 

O 

Four Data Points 

o 

Five Data Points 

O 

Six Data Points 

o 

Eight Data Points 


Logarithmic Fit 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 


Eigure 4-5. MAX GAP (LAMARS) Phase 2 Sum-of-sines Task Data with Logarithmie 

Curve Lit 
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PIO Tendency Rating C PIO Tendency Rating 



a 

Single Data Points 

0 

Two Data Points 

o 

Three Data Points 

O 

Four Data Points 

— 

Linear Fit 


Data Basis: 15Kft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration; Cruise 
Test Dates: 22 August 2003 


4-6. MAX GAP (LAMARS ) Phase 3 Discrete HUD Pitch Tracking Task Data 

with Logarithmic Fit 



o 

Single Data Point 

O 

Two Data Points 

O 

Three Data Points 

o 

Four Data Points 

— 

Linear Fit 


Data Basis: 15Kft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 


0.0 0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 


Gap Criterion 


Figure 4-7. MAX GAP (LAMARS) Phase 3 Target Tracking Task Data with 

Logarithmic Fit 
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MAX GAP (LAMARS) Summary 

Each dataset shows correlation and each linear correlation confidence level is 
better than 99%. The HAVE PREVENT and HAVE OEOP data analyses bore out the 
fact that correlation exists between the Gap Criterion and PIOR and the EAMARS 
portion of Project MAX GAP reinforces this assertion. 
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V. Analysis of Project MAX GAP (VISTA) Data 

More Gap Criterion and PIO tendency rating was acquired in the flight test 
portion of Project MAX GAP. The VISTA NF-16D was used to accomplish this. Again, 
the same Phase 2 Sum-of-sines Tracking Task, Phase 3 Discrete HUD Pitch Tracking 
Task and Phase 3 Target Tracking Task described in Chapter III were used. The PIOR 
scale used was the MIL-HDBK-1797 one previously described in Chapter I. 

MAX GAP (VISTA) Analysis 

The same four sets of bare aircraft dynamics and the same three actuator rate 
limits used in the MAX GAP LAMARS test were requested for the VISTA aircraft. The 
actuator rate limits were easily programmed, but, unfortunately, obtaining exact matches 
in the VISTA NF-16D is as much an art as a science. Compounding the problem, only 
one calibration sortie was accomplished due to project time constraints. The bare aircraft 
dynamics for Cases B and N were suitably close to the specified values, but the 
augmented dynamics for Case B were significantly different. The bare aircraft dynamic 
damping ratio for Case N was almost perfect, but the requested natural frequency was 
less by 1 rad/sec. Case Y proved to be an overdamped though stable system. The short 
period characteristics of these cases were used for the actual Gap Criterion analysis and 
are shown in Table 5-1. 

As described in the test report for Project MAX GAP, poor task setup and 
execution were experienced in the Phase 3 Target Tracking Task. The T-38A target 
aircraft was allowed to develop too much angle away from the VISTA prior to an 
engagement being conducted. As a result of this initial offset and less than expected turn 
performance in the VISTA, the gross acquisition task turned into a low gain task, rather 
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than the high gain task of a Category A maneuver (Witte and others, 2003:10). For these 
reasons, this dataset was ignored in this study. Additionally, the MAX GAP test team 
found instances where the evaluation pilots missed critical PIO cues such as aircraft lag 
response and assessed improper PIOR. These data points were omitted in the “reduced 
dataset” results of Project MAX GAP. These reduced datasets were used for this study. 


Table 5-1. MAX GAP (VISTA) Case Characteristics (Witte and others, 2003) 


Case 

Bare Aircraft 
Poles 

®sp 

Csp 

Kq 

Ka 

Aircraft Poles with 
Stability Augmentation 

B 

-1.42±1.85j 

-.017±.074j 

2.33 

0.61 

-0.0212 

0.0877 

-1.98±-1.69j 

-.017±.065j 

N 

-.493±2.86j 

-.017±.074j 

2.90 

0.17 

-0.408 

0.254 

-2.29±1.95j 

-.018±.031j 

W 

-3.26±1.77j 

-.017±.074j 

3.70 

0.88 

-0.0946 

-0.185 

-2.10±2.14j 

-.017±.082j 

Y 

-3.02, -0.96 
-.017±.074j 

1.70 

1.17 

0.485 

0.0400 

-2.09±2.14j 

-.017±.083j 


Gap Criterion Calculation for MAX GAP (VISTA) Datasets. 

Step 1. 

The pitch-to-actuator transfer functions for the bare aircraft dynamics are shown 
in Table 5-2: 


Table 5-2. MAX GAP (VISTA) Pitch-to-Actuator Transfer Functions (G^) 


Case 


B 

-11.08/-14.375-0.5277 

5 V 2 . 8775 ' +5.5315^ +0.2015 + 0.0313 

N 

-II.O 85 "- 14 . 375 - 0.5277 

5 V1. 025 ' + 8 . 4495 " + 0.29165 + 0.04848 

W 

- 11 . 095 "-14.375-0.5277 

5^ + 6.5465" + 13 . 925 " +0.5035 + 0.07892 

Y 

-II.O 85 "- 14 . 375 - 0.5277 

5 V 4 .OI 25 " + 3 .O 3 I 5 " +0.12125 + 0.01666 
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Step 2. 


Does not apply; all four cases have stable poles for their bare aircraft dynamics. 
Step 3. 

Actuator dynamics for this dataset were . 

5 + 20 

Step 4. 

The Neal-Smith pilot model transfer functions are shown in Table 5-3 along with 
the augmented dynamics for which they were computed (Doman and Porringer, 1996); 


Table 5-3. MAX GAP (VISTA^ 

1 Neal-Smith Pilot Models 

Case 


'^actuator '^augmented 

B 

(55 + 1) (0.531355 + 1) 
0.078997^ 

5 (0.00015 + 1) 

-221.75^-287.55-10.55 

5 ' + 22 . 885 ^ + 82.485^ +131. 35 " + 4.81 15 + 0.5853 

N 

(55 + 1) (0.427045 + 1) 

0.0953 N 

5 (0.00015 + 1) 

-221.75^-287.55-10.55 

5 ' +21.025^84.655' +151. 15 " +5.4965 + 0.5768 

W 

(55 + 1) (0.344515 + 1) 

0.12846^ ^g-0.25. 

5 (0.00015 + 1) 

- 221 . 75 '-287.55-10.55 

5 ' + 26 . 555 " + 103 . 65 ' + 204 . 45 ' +7.4485 + 1.397 

Y 

(55 + 1) (0.354875 + 1) 

0.11293^ ^g-0.25. 

5 (0.00015 + 1) 

- 221 . 75 '-287.55-10.55 

5 ' + 24 .OI 5 " +92.645' +I 8 O. 65 ' +6.6265 + 1.263 


Step 5 and 6. 

Figure 5-1 shows the Nichols charts for Cases B, N, W and Y: 

Step 7. 

Cases B and W are of Type I, Case N is Type II and Case Y is Type III. 
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Nichols Chart 



Case B 


Nichols Chart 



Case N 


Nichols Chart Nichols Chart 




Figure 5-1. MAX GAP (VISTA) Nichols Charts for Cases B, N, W and Y 


Type I, Step 1-1 through 1-2. 

The minimum amount of effective increase in gain for Cases B and W along with 
the determined values for K*, ro and Amax, are shown in Table 5-4: 


Table 5-4. MAX GAP (VISTA) Components for Cases B and W 


Case 

AK^(dB) 

K* 

(u(rad/s) 

Afnax (deg) 

Case B 

6.457 

0.736 

3.57 

30 

Case W 

11.257 

0.922 

6.12 

30 
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The final values for the Gap Criterion and amplitude for these two oases and rate 


limits are shown in Table 5-5: 


Table 5-5. Gap Criteria Values for MAX GAP (VISTA) Cases B and W 


Case 

Maximum Actuator 
Deflection Rate (Vl, deg/sec) 

A (deg) 

Gap 

Criterion 

B 

15 

8.97 

0.6287 

30 

17.93 

1.2573 

60 

35.87 

2.5146 

W 

15 

4.18 

0.5129 

30 

8.35 

1.0257 

60 

16.70 

2.0515 


Type II, Step 2-1 through 2-2. 

The minimum amount of effeotive deorease in gain for Case N, along with the 
determined values for K*, w and Amax, are shown in Table 5-6: 


Table 5-6. MAX GAl 

(VISTA) Components for Case N 

Case 

^K^idB) 

K* 

(u(rad/s) 

Amax (d^§) 

Case N 

-3.998 

0.784 

3.26 

30 


The final values for the Gap Criteria and amplitudes for Case N and its respective 
rate limits are shown in Table 5-7: 


Table 5-1. Gap Criteria Values for MAX GAP (VISTA) Case N 


Case 

Maximum Actuator 
Deflection Rate (Vl, deg/sec) 

A (deg) 

Gap 

Criterion 

N 

15 

9.22 

0.1939 

30 

18.44 

0.3879 

60 

36.88 

0.7758 
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Type HI, Step 3-1 through 3-4. 

The determined values for K*, co, A^ax and Gap Criterion for eaeh rate limit 
applied to Case Y are shown in Table 5-8; 


Table 5-8. Gap Criteria for MAX GAP (VISTA) Case Y 


Case 

K* 

(u(rad/s) 

A max 

(deg) 

^(deg) 

Maximum Actuator 
Deflection Rate (Vl, 
deg/sec) 

Gap 

Criterion 





40.40 

15 

1.3467 

Y 

0.540 

1.08 

30 

80.80 

30 

2.6934 





161.60 

60 

5.3868 


MAX GAP (VISTA) Gap Criterion Summary. 

Table 5-9 summarizes the Gap Criteria for the flight test portion of Project MAX 


GAP. 


Table 5-9. MAX GAP (VISTA) Gap Criteria Summary 


Case 

Maximum Actuator 
Deflection Rate (Vl, deg/sec) 

Gap 

Criterion 

B 

15 

0.6287 

30 

1.2573 

60 

2.5146 

N 

15 

0.1939 

30 

0.3879 

60 

0.7758 

W 

15 

0.5129 

30 

1.0257 

60 

2.0515 

Y 

15 

1.3467 

30 

2.6934 

60 

5.3868 


MAX GAP (VISTA) Gap Criterion Correlation. 

The PIOR and Gap Criterion data were paired and plotted in Figures 5-2 and 5-3: 
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PIO Tendency Rating PIO Tendency Rating 


6 


Q Single Data Point 


O Two Data Points 
Three Data Points 

o Four Data Points 

O Five Data Points 


Five Data Points 


^ ° y =-0.4536X + 3.975 O P' 

R^ = 0.1601 _ 

|R| = 0.4001 

^ ^ „ ___ ^ ( ) Five Data Po 

3 O o o \ O ^ 

^ I Linear Fit 

2 o OO) O Oo O I - 

I I Data Basis: 15Kft PA, 300 
Test A/C: NF-16D-# 86-00 

1 O C C 3 00 d) Acquisition System: Hand 

Configuration: Cruise/VS 

______ Test Dates: 20-22 October 

0.0 1.0 2.0 3.0 4.0 5.0 6.0 

Gap Criterion 

Figure 5-2. MAX GAP (VISTA) Phase 2 Sum-of-sines Task Data 


Data Basis: ISKft PA, 300 KiAS 
Test A/C: NF-16D - # 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise/VSS Engaged 
_ Test Dates: 20-22 October 2003 


5 GD ooo 

4 OQ> (© oo 

3 (^oo'''d ©e- 

2 o CCO O Oo 


y = -0.2334X + 3.624 
R^ = 0.1094 
|R| = 0.3308 


2.0 3.0 4.0 

Gap Criterion 


o 

Single Data Point 

O 

Two Data Points 

o 

Three Data Points 

— 

Linear Fit 


I Data Basis: 1SK ft PA, 300 KIAS 
Test A/C: NF-16D - # 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise/VSS Engaged 
Test Dates: 20-22 October 2003 


Figure 5-3. MAX GAP (VISTA) Phase 3 Diserete HUD Piteh Tracking Task Data 
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As in the previous analyses, the probability of a linear eorrelation existing for the 


data was investigated as deseribed in Appendix C. The linear fit depieted on the plots 
displays this eorrelation. 

Again, eonfidenee level was used to determine if a relationship existed between 
PIOR and eorresponding Gap Criterion values. A 95% eonfidenee level was maintained 
as the threshold for justifiably aceeptable eorrelation (Wheeler and Ganji, 1996:147). A 
table listing the linear correlation coefficient, minimum correlation coefficient and 
confidence level for both datasets of the flight test portion of Project MAX GAP is shown 
below. 


Table 5-10. MAX GAP (VISTA) Correl 

[ation Confidence Levels 

Dataset 

Sample 

Size 

95 % Confidence 
Minimum 
Correlation 

Actual Linear 
Correlation 

Actual 

Confidence Level 

Phase 2 
Sum-of-sines 

71 

0.233 

0.400 

99.95% 

Phase 3 Discrete 
Pitch Tracking 

46 

0.291 

0.331 

97.53% 


MAX GAP (VISTA) Best Curve Fit. 

Multiple curve fits were attempted for these datasets as well. The same 
exponential, natural logarithmic, polynomial and power series interpolations were tried. 
The correlation coefficient of each fit was calculated and the results are listed below. 
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Table 5-11. MAX GAP (VISTA) Curve Fit Correlation Values 


Dataset 

Linear 

Exponential 

Logarithmic 

2"^ Order 
Polynomial 

Power Series 

Phase 2 
Sum-of-sines 

0.400 

0.372 

0.414 

0.430 

0.399 

Phase 3 Discrete 
Pitch Tracking 

0.331 

0.312 

0.357 

0.368 

0.355 


Yet again the seeond order polynomial curve fit gives the highest correlation 
values. But this curve fit still does not match well at higher Gap Criterion values. Just as 
in the preceding analyses, the natural logarithmic curve fit does a better job of endpoint 
matching while maintaining a relatively high correlation factor. Figures 5-4 and 5-5 
show the data with this logarithmic curve fit. 
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O 
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o 
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o 
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— 
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Data Basis: 15K ft PA, 300 KIAS 
Test A/C: NF-16D - it 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise/VSS Engaged 
Test Dates: 20-22 October 2003 


6.0 


Figure 5-4. MAX GAP (VISTA) Phase 2 Sum-of-sines Task Data with Logarithmic 

Curve Fit 
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Data Basis: 15K ft PA, 300 KIAS 
Test A/C: NF-16D - it 86-00048 
jAcquisition System: Hand Held 
Configuration: Cruise/VSS Engaged 
Test Dates: 20-22 October 2003 
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Gap Criterion 


5.0 


6.0 


Figure 5-5. MAX GAP (VISTA) Phase 3 Diserete HUD Piteh Traeking Task Data with 

Logarithmie Curve Fit 


MAX GAP (VISTA) Summary 

Just is in the MAX GAP (LAMARS) analyses, eaeh dataset shows eorrelation and 
eaeh linear eorrelation eonfidenee level is better than 95%. The HAVE PREVENT, 
HAVE OEOP, MAX GAP (LAMARS) and MAX GAP (VISTA) individually 
demonstrate the eorrelation between Gap Criterion and PIO tendeney rating. To 
determine if the Gap Criterion ean be broadly applied, a eorrelation within eombined 
datasets must be aeeomplished. 

In Chapter VI, the datasets are eombined and the data are analyzed for eorrelation 
between the PIOR and the Gap Criterion. 
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VI. Analysis of Combined Gap Criterion Data 

In the previous sections, correlation for individual datasets has been assessed and 
best fit curves and data correlation have been established. But, the Gap Criterion is 
supposed to be applied universally. The effects of combining datasets will now be 
examined. Datasets will be combined for Handling Qualities Phase, task and source. 
Finally, simulator and flight test results will be combined for each Handling Qualities 
phase and task. Combining Handling Qualities phases was not considered due to 
differences in pilot control techniques, specifically HQDT versus operational flying 
styles (Brown and others, 2002:21-18 to 21-19). 

Figures 6-1 through 6-3 have all datasets obtained from LAMARS plotted 
together and Figure6-4 and 6-5 show all VISTA data. 

LAMARS Combined Datasets 



0.0 0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 



Single Data Point 
Two Data Points 

Three Data Points 

Four Data Points 

Five Data Points 

Six Data Points 
Eight Data Points 
Logarithmic Fit 


□ 

HAVE PREVENT Data 

0 

MAX GAP Data 


Gap Criterion 


Figure 6-1. LAMARS Combined Phase2 Sum-of-sines Dataset 
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PIO Tendency Rating PIO Tendency Rating 



Gap Criterion 


ure 6-2. 


LAMARS Combined Phase 3 Diserete (HUD) Piteh-Traeking Dataset 



0.0 0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 

Gap Criterion 


Figure 6-3. LAMARS Combined Phase3 Target Traeking Dataset 
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VISTA Combined Datasets 
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AO 
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AO 

Three Data Points 

AO 

Four Data Points 

AO 

Five Data Points 

A 

Sixteen Data Points 
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0.0 0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0 5.5 6.0 


Gap Criterion 

Figure 6-4. VISTA Combined Phase 2 Sum-of-sines Dataset 
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Figure 6-5. VISTA Combined Phase 3 Diserete (HUD) Piteh-Traeking Dataset 
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PIO Tendency Rating PIO Tendency Rating 


LAMARS and VISTA Combined Dataset Correlation 



Figure 6-6. LAMARS and VISTA Combined Phase 2 Sum-of-sines Data 
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Figure 6-7. LAMARS and VISTA Combined Phase 3 Diserete Piteh-Traeking Data 
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Combined Dataset Analysis and Observations 

Each combined dataset far exceeded a 95% confidenee level that eorrelation 
existed. In fact, the lowest correlation confidence level was 99.95% for the LAMARS 
Combined Phase 3 Target Tracking. The logarithmic curve fits shown in the previous 
figures proved to be the best eombination of high correlation factor and endpoint 
matching for both high and low Gap Criterion values. 

Further inspeetion of the plots reveals some trends. From the PIO tendency scale 
shown in Figure 1-4 of Chapter I, a PIOR of 4, 5 or 6 represents a tendency for PIO while 
a PIOR of I, 2 or3 represents no tendency for PIO, though some undesirable motions are 
still possible. From the eombined dataset figures in ean be seen that PIOR rating is an 
inverse funetion of the Gap Criterion: High PIOR come at low Gap Criterion values and 
vice versa. Also, from these figures it can be seen that, in general, the majority of PIO 
tendency ratings 4, 5, and 6 occur at Gap Criterion values less than approximately 1.0 
while PIO tendency ratings at Gap Criterion values above 1.0 tend to be non-PIO values 
of 1, 2 or 3. These two observations were more pronounced in the Phase 2 Sum-of-sines 
Tracking Task than in the Phase 3 tasks. This is possibly due to the high gain, high 
bandwidth piloting teehnique used in this task while the other tasks were more foeused on 
task performanees which required both high and low gains and bandwidths. 

The Gap Criterion value of 1.0 also has physical significance. Consider a Type I 
solution in which G{s) was such that AAp approached zero. Then the Gap Criterion 
would simply be the amplitude to eause PIO divided by the maximum amplitude 
available and if this Gap Criterion equals 1.0 then the amplitude to eause PIO would be 
equal to the maximum amplitude available. Hence, any Gap Criterion value greater than 
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1.0 would require more aetuator defleetion than was available, thereby providing a 
natural limit to ereating a PIO. In other words, if an amplitude of 35 degrees were 
required, with only 30 degrees available, it is readily apparent that a PIO cannot be 
achieved. 

The relatively high correlation factors, especially for the Combined Phase 2 Sum- 
of-sine datasets indicate the potential for Gap Criterion validation and acceptance as a 
tool for predicting Category II PIO due to rate-limited actuators. 
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VII, Conclusions 


In this study, a new criterion for predicting pilot-induced oscillation tendency 
rating due to rate-limited actuators was developed and correlated to datasets of these 
ratings. This criterion was called the Gap Criterion. 

Two historical databases, Projects HAVE PREVENT and HAVE OEOP were 
selected to see if the Gap Criterion had merit. Most datasets were assessed with greater 
than 95% confidence that a correlation indeed existed. Eurther, a logarithmic curve fit 
was deemed best. Eollow on testing in Project MAX GAP gathered more PIO tendency 
rating data to augment these earlier findings. These datasets also showed strong evidence 
of correlation and again found a logarithmic interpolation of the data worked well. 

These datasets were combined for different tasks and sources to determine 
whether the Gap Criterion was universal in nature. This seemed to be the case with all 
combined datasets indicating greater than 99.95% confidence level that correlation 
existed between the PIOR and the Gap Criterion. Eogarithmic curve fits again appeared 
superior with high relative correlation factors and good endpoint matching. 

Eurther observations were made for the combined datasets. Based on the relative 
positions of a majority of the data, it was found that lower Gap Criterion values resulted 
in higher PIO tendency ratings and vice versa. Eurther, proper PIO represented by PIO 
tendency rating values of 4, 5 or 6 were clustered at Gap Criterion values of 1.0 or less 
while PIO tendency ratings of 1, 2 or 3, representing non-PIO, were more prevalent at 
Gap Criterion values greater than 1.0. 

The Gap Criterion has merit. It should be used as a tool to predict and reduce 
incidents of Category II PIO due to rate-limited actuators during aircraft development. 
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Appendix A. Matlab/Simulink™ Code 


This appendix lists the Matlab^"^ souree code used to move the short period poles 
of the F-16 to desired locations and then determine the feedback gains for angle-of-attack 
and pitch rate necessary to augment the new bare aircraft dynamics and return them to 
suitable closed loop dynamics. A Simulink™ diagram is also shown and was used for 
the preceding process. The next code listing computes the Gap Criterion for various bare 
aircraft dynamics and rate limit choices. 

Bare Aircraft Pole Placement 

%Bare Aircraft Dynamics Bare Pole placement 

%Tliis matlab file will take the bare F-16 dynamics at 15,000 ft Pressure Altitude, 

%300 KCAS and place the short period poles where I want them based 
%on what I give for short period damping and natural frequency. 

clear;clc;format short g; format compact 
warning off 

a = [-0.033104 0.14957 -0.3207 -0.56111; 

-0.015511 -1.2826 1 -0.0024621; 

0.008081 -4.0875 -1.7556 0.0012828; 

0 0 1 0 ] 

b = [-0.5193; 

-0.05243; 

-11.085; 

0 ] 

c = eye(4) 
d = [0;0;0;0] 

%Input the Desired Short Period Damping Ratio and Short Period Natural Frequency for test case 
%Example: MAX GAP LAMARS Case B zetasp = 0.61, omegansp = 2.34 

zetasp = inputf Short Period Damping Ratio:'); 
omegansp^ inputfShort Period Natural Frequency:'); 
sigma = zetasp*omegansp 
omegad = omegansp*sqrt(l-zetasp^2) 

%Compute P vector to "place" the poles for the desired Short Period Damping 
%Ratio and Short Period Natural Frequency. 

%Also, Phugoid pole locations are chosen as -0.017+/-0.074j 

%(Phugoid Damping Ratio = 0.224, Phugoid Natural Frequency = 0.075928 rad/s) 

P=[-.017+.074*j -.017-.074*j -sigma-l-omegad*j -sigma-omegad*j] 

kinner=-1 *place(a,b,P) 

'ahat is a-l-b*kinner' 
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ahat=a+b *kimier 
'eigenvalues of ahat' 
eigenvalues = eig(aliat) 

'natural frequencies and dampings of ahaf 
[wwn,zz]=damp(aliat) 

'(Phugoid Damping Ratio = 0.2239, Phugoid Natural Frequency = 0.075928 rad/s)' 

[num, den]=s s2tf(aliat ,b, c,d) 

BareAcftLongDynamics=tf(num(4,:),den) 
continuing = input('continue'); 

%Tbe following are tbe pbugoid and short perios (spl & sp2) poles for the DESIRED 
%(must be changed if desired closed loop characteristics are different) 

%closed loop system using angle-of-attack (alpha) and pitch rate (q) feedback: 

phugoidl=-.017+.074*j;phugoid2=-.017-.074*j;spl=-2.2+2.22*j;sp2=-2.2-2.22*j 

P2=[phugoidl phugoid2 spl sp2] 

K=place(ahat,b,P2) 

%Find approximate values of Kq (call it Kqbase) and 
%Kalpha (call it Kalphabase) 

Kqbase=-K(l,3) 

Kalphabase=-K( 1,2) 

%Find best Kq and Kalpha 

%This is an iterative, graphical technique to find Kalpha and Kq that take the 
%bare aircraft dynamics and change them into the desired closed loop dynamics 
%The error function {E(ii)=abs(wn(3)-3.125)+4.439*abs(z(3)-.7)} is important 
%in that it relates to the closed loop short period natural frequency desired (3.125) 

%and the short period damping ratio desired (.7). The constant 4.439 is a weighting funtion 
%so that frequency and damping ratio are considered equally (3.125/.7 = 4.439) 

%This is to get a ballpark Kalpha and Kq 

ii=l 

forkq = Kqbase-1:.025 :Kqbase+l; 
for kalpha = Kalphabase-l:.025:Kalphabase-l-l; 

Kqcounter(ii)=kq;Kacounter(ii)=kalpha; 

[A2,B2,C2,D2]=LINMOD('AugmentedDynamics',0); 

Yc=ss(A2,B2,C2,D2); 

[Yctfnum,Yctfden]=ss2tf(A2,B2,C2,D2); 
yctf=tf( Y ctfnum, Y ctfden); 

[ wn,z] =damp (yctf); 
wnn(ii)=wn(3) ;zz(ii)=z(3) ;iii(ii)=ii; 

E(ii)=abs(wn(3)-3.125)-l-4.439*abs(z(3)-.7); 

ii=ii-H 

end 

end 

plot(iii,E) 

grid on 
grid minor 
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xx=input('what index?') 
'kq',Kqcounter(xx) 
'kalpha',Kacounter(xx) 
Kqbase=Kqcounter(xx); 
Kalphabase=Kacounter(xx); 


%This is to get a more preeise Kalpha and Kq 
ii=l 

forkq = Kqbase-.l:.0025:Kqbase+.l; 

for kalpha = Kalphabase-. 1:.0025:Kalphabase+. 1; 
Kqeounter(ii)=kq;Kacounter(ii)=kalpha; 
[A2,B2,C2,D2]=LINMOD('AugmentedDynamics',0); 
Yc=ss(A2,B2,C2,D2); 
[Yctfnum,Yctfden]=ss2tf(A2,B2,C2,D2); 
yctf=tf( Y ctfnum, Y ctfden); 

[wn,z]=damp(yctf); 
wnn(ii)=wn(3) ;zz(ii)=z(3) ;iii(ii)=ii; 
E(ii)=abs(wn(3)-3.125)+4.439*abs(z(3)-.7); 
ii=ii+l 
end 
end 

plot(iii,E) 

grid on 
grid minor 

xx=input('what FINAL index?') 


%Final results 


kq=Kqcounter(xx) 

kalpha=Kacounter(xx) 

[A2,B2,C2,D2]=LINMOD('AugmentedDynamics',0); 

Yss=ss(A2,B2,C2,D2); 

[Ynum,Yden]=ss2tf(A2,B2,C2,D2) 

Ytf=t f( Ynum, Y den) 
damp(Ytf) 
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kalpha feedback 


Figure A-1. Augmented Dynamies Simulink™ Model 


Gap Criterion Computation 

%This Matlab file will be used to take LAMARS Cases B, N, W and Y and compute the Gap 
Criterion 
% Maj Joel Witte 
% 04 Nov 03 

%This Matlab file takes the bare aircraft dynamics (Gc) and multiplies by the closed loop 
modified %Neal-Smith pilot model (Gp). Then the delta gain, gap (or AKp), is calculated and 
kstar and omega %are determined. 

%Finally, the Gap Criterion is determined for each max actuator rate. 
clear;clc;clf;format compact 

figure(l) 

% 

%The following are the parameters for the MAX GAP LAMARS evalutions. 

% Gc = bare aircraft dynamics 
%Gp = Neal-smith pilot model 

%G = bare aircraft dynamics convolved with the Neal-Smith Pilot Model 
%Choose which case by commenting/uncommenting the parameters 
%For example, currently Case B will be computed 

%Case B 

Gcb=tf([-11.08 -14.37 -0.5277],[1 2.889 5.578 0.2026 0.03157]) 

Gpb=-.11483*tf([.32483 1],[.00001 l])*tf([5 1],[1 0],'iodelay',.25); 

G=Gcb*Gpb 

%Case N 

% Gcn=tf([ -5.551e-015 -11.09 -14.37 -0.5277],[1 1.912 9.867 0.3439 0.05648]) 
%Gpn=-.10919*tf([.32699 1],[.00001 l])*tf([5 1],[1 0],'iodelay',.25); 

% G=Gcn*Gpn 

%Case W 

% Gcw=tf([-3.553e-015 -11.09 -14.37 -0.5277],[1 8.512 22.48 0.8031 0.1279]) 
%Gpw=-.15254*tf([.30311 1],[.00001 l])*tf([5 1],[1 0],'iodelay',.25); 

% G=Gcw*Gpw 
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%Case Y 

%Gcy=tf([-6.217e-015 -11.08 -14.37 -0.5277],[1 4.21 5.53 0.2071 0.03103]) 
%Gpy=-.12528*tf([.31318 1],[.00001 l])*tf([5 1],[1 0],'iodelay',.25); 
%G=Gcy*Gpy 


W=LOGSPACE(log 10(. 1 ),log 10(10), 1000); 


ii=0; 

for kstarr=.l:.001:1; 
ii=ii-G; 

kstar(ii)=kstarr; 

mag_N (ii)=-20 *log 10(8 *kstarr/(pi^2)); 
ph_N(ii)=(180/pi)*acos(kstarr) - 180; 
end 

figure(l) 
nichols(G,W) 
grid on 
hold on 

plot(ph_N,mag_N,'r') 
axis([-200 -70 -20 30]) 
grid on 

wl=input('what freq (rad/s) range? Low end =') 
w2=input('high end -) 

W1 =LOGSPACE(log 10(w 1 ),log 10(w2), 1000); 
[mag_checkl,phase_checkl] = NICHOLS(G,Wl); 
mag_check=squeeze(mag_check 1); 
phase_check=squeeze(phase_checkl); 

check = polyfit(phase_check,mag_check,9) 
swoosh = polyfit(ph_N,mag_N,9) 

for phase=-100:-.l:-170; 

checkmagdBQJ )=20 * log 10(polyval(check,phase)); 
checkphase(jj)=phase; 

jj=jj+i; 

end 

for phase=-100:-.l:-170; 

swooshmagOJ )=polyval(swoosh,phase); 
swooshphase(jj)=phase; 

end 

dB=swooshmag-checkmagdB; 

[Gap,index] = min(dB) 

inc=10^(Gap/20) 

nichols(G*inc,W) 
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hold on 

axis([-200 -70 -20 30]) 
omega=input('just touchin omega') 

[magtouch,phasetouch]=bode(G,omega) 

ii=l; 

for kstarr=.l:.001:1; 
if ph_N(ii)>phasetoueh 
kstai^kstarr; 
end 

end 

kstar 

maxdeg=30 

%Compute Gap Criterion for rate limits 15 deg/sec, 30 deg/see and 60 deg/see 
GapCriterion 15=inc * (pi * 15/(2 *omega*kstar*maxdeg)) 

GapCriterion30=ine * (pi * 30/(2 *omega*kstar*maxdeg)) 

GapCriterion60=ine * (pi * 60/(2 *omega*kstar*maxdeg)) 

'done' 
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Appendix B, State Space Matrices for Project MAX GAP 


This appendix lists the state space matrices for the F-16 dynamics as well as the 
bare aircraft dynamics of each case for Projects HAVE PREVENT, HAVE OEOP and 
MAX GAP. 


F-16 Dynamics 



- 0.033104 


0.14957 

- 0.3207 

- 0.56111 


- 0.5193 


- 0.015511 


- 1.2826 

1 

- 0.002462 

K — 

- 0.05243 

3 . — 

0.008081 


- 4.0875 

- 1.7556 

0.001283 

D — 

- 11.085 



0 


0 

1 

0 



o| 


1 

0 

0 

0 




0 



0 

1 

0 

0 




0 


C = 

0 

0 

1 

0 



d = 

0 



0 

0 

0 

1 




0 



Modified Matrices 

The following matrices are the pole placement results (A = a + b*kinner). 

HAVE PREVENT 


Case A 


A = 


- 0.033094 

- 0.01551 

0.008304 

0 


0.069282 

- 1.2907 

- 5.8013 

0 


- 0.38266 

0.99374 

- 3.0782 

1 


- 0.56125 

- 0.002477 

- 0.001753 

0 


Case B 


A = 


- 0.033093 0.17889 

- 0.01551 - 1.2796 

0.008312 - 3.4615 

0 0 


- 0.3122 - 0.56093 
1.0009 - 0.002444 
- 1.5741 0.005109 
1 0 


Case C 


A = 


- 0.033114 

- 0.015512 

0.007874 

0 


0.3331 

- 1.2641 

- 0.16992 

0 


- 0.2587 

1.0063 

- 0.43222 

1 


- 0.56113 

- 0.002464 

0.00081 

0 
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Case D 


-0.033102 0.38576 -0.20764 -0.56119 

-0.015511 -1.2588 1.0114 -0.00247 

0.008121 0.95415 0.65786 -0.000441 

0 0 10 


HAVE OLOP 


Case A 



-0.035901 

-0.21367 

-0.22435 -0.56209 


-0.015793 

-1.3193 

1.0097 -0.002562 


-0.051625 

-11.841 

0.30117 -0.019725 


0 

0 

1 0 

Case B 




-0.033649 

0.31011 

-0.23615 -0.56149 


-0.015566 

-1.2664 

1.0085 -0.0025 


-0.003556 

-0.66055 

0.04924 -0.006762 


0 

0 

1 0 

Case C 




-0.033422 

0.20283 

-0.29951 -0.56139 


-0.015543 

-1.2772 

1.0021 -0.00249 


0.001303 

-2.9505 

-1.3034 -0.004668 


0 

0 

1 0 

Case D 




-0.033278 

0.44459 

-0.21943 -0.5614 


-0.015529 

-1.2528 

1.0102 -0.002491 


0.004371 

2.2099 

0.40609 -0.00486 


0 

0 

1 0 

MAX GAP (LAMARS) 


Case B 




-0.033384 

0.17915 

-0.31228 -0.56137 


-0.015539 

-1.2796 

1.0009 -0.002489 


0.002102 

-3.456 

-1.5758 -0.004294 


0 

0 

1 0 
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CaseN 



-0.034932 

-0.080584 

-0.26522 -0.56181 


-0.015696 

-1.3058 

1.0056 -0.002533 


-0.030946 

-9.0004 

-0.57123 -0.013697 


0 

0 

1 0 

Case W 




-0.032474 

-0.27041 

-0.57362 -0.56097 


-0.015447 

-1.325 

0.97446 -0.002448 


0.021525 

-13.052 

-7.1545 0.004179 


0 

0 

1 0 

Case Y 




-0.032397 

0.26148 

-0.37461 -0.56107 


-0.01544 

-1.2713 

0.99456 -0.002458 


0.023175 

-1.6987 

-2.9063 0.002109 


0 

0 

1 0 

MAX GAP (VISTA) 


Case B 




-0.033384 

0.18062 

-0.31171 -0.56137 


-0.015539 

-1.2795 

1.0009 -0.002489 


0.002103 

-3.4248 

-1.5638 -0.004301 


0 

0 

1 0 

Case N 




-0.03532 

-0.068363 

-0.22347 -0.56194 


-0.015735 

-1.3046 

1.0098 -0.002546 


-0.039218 

-8.7395 

0.31992 -0.016428 


0 

0 

1 0 

CaseW 




-0.032282 

0.010816 

-0.48286 -0.56098 


-0.015428 

-1.2966 

0.98363 -0.002449 


0.02563 

-7.0493 

-5.2171 0.004129 


0 

0 

1 0 
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Case Y 


A = 


-0.032063 0.36636 -0.36584 -0.56099 

-0.015406 -1.2607 0.99544 -0.00245 

0.030312 0.54004 -2.7192 0.003902 

0 0 10 
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Appendix C, Correlation Computation 
Data Reduction and Analysis 

The pre-computed Gap Criterion for the seleeted bare aireraft and rate limit 
eonfiguration was plotted with the assigned PIO Tendeney Rating. The eonfidenee level 
of the data eorrelation was determined by eomputing a eorrelation eoeffieient, r ^, shown 

in equation C-1 (Wheeler and Ganji, 1996:145-155). 


^(x.-x)(y.-y) 


r = 

AT- 


/=! 


-, 1 / 




/=! 


/=! 


(C-1) 


Where n is the number of data pairs and x and y are the mean values of x andy whieh 
were obtained from: 




St- 




y = — 


(C-2) 


To determine if there is eorrelation to a eertain degree of eonfidenee, the absolute 
value of the eorrelation eoeffieient, r^ ,for n data pairs is eompared to the minimum 


values of the eorrelation eoeffieient shown in Table C-1: 
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Table C-1. Minimum Values of the Correlation Coefficient for Confidence Level 
__ (Wheeler and Ganji, 1996:147) _ 


n 

Confidence Level 

80% 

90% 

95% 

98% 

99% 

3 

0.951 

0.988 

0.997 

1.000 

1.000 

4 

0.800 

0.900 

0.950 

0.980 

0.990 

5 

0.687 

0.805 

0.878 

0.934 

0.959 

6 

0.608 

0.729 

0.811 

0.882 

0.917 

7 

0.551 

0.669 

0.754 

0.833 

0.875 

8 

0.507 

0.621 

0.707 

0.789 

0.834 

9 

0.472 

0.582 

0.666 

0.750 

0.798 

10 

0.443 

0.549 

0.632 

0.715 

0.765 

11 

0.419 

0.521 

0.602 

0.685 

0.735 

12 

0.398 

0.497 

0.576 

0.658 

0.708 

13 

0.380 

0.476 

0.553 

0.634 

0.684 

14 

0.365 

0.458 

0.532 

0.612 

0.661 

15 

0.351 

0.441 

0.514 

0.592 

0.641 

16 

0.338 

0.426 

0.497 

0.574 

0.623 

17 

0.327 

0.412 

0.482 

0.558 

0.606 

18 

0.317 

0.400 

0.468 

0.543 

0.590 

19 

0.308 

0.389 

0.456 

0.529 

0.575 

20 

0.299 

0.378 

0.444 

0.516 

0.561 

25 

0.265 

0.337 

0.396 

0.462 

0.505 

30 

0.241 

0.306 

0.361 

0.423 

0.463 

35 

0.222 

0.283 

0.334 

0.392 

0.430 

40 

0.207 

0.264 

0.312 

0.367 

0.403 

45 

0.195 

0.248 

0.294 

0.346 

0.380 

50 

0.184 

0.235 

0.279 

0.328 

0.361 

100 

0.129 

0.166 

0.197 

0.233 

0.257 

200 

0.091 

0.116 

0.138 

0.163 

0.180 
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Appendix D, MAX GAP Histograms 

The MAX GAP LAMARS and VISTA test histograms are eontained in this 
appendix. These charts show the raw data collected and indicate which datapoints were 
considered outliers and omitted from the reduced dataset (Witte and others, 2003). Pilots 
1, 2 and 3 were the same individual in each case. 

MAX GAP (LAMARS) Histograms 

Handling Qualities Phase 2 Sum-of-sines Task 


Data Basis; 15KftPA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates; 22 August 2003 



Evaluation Pilot 


Figure D-1. LAMARS Phase 2 Sum-of-sines Data, Case B, 15 deg/sec 
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PIOR PIOR 


Data Basis: 15KftPA, 300 KIAS 
Test A/C; LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 
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Evaluation Piiot 


Figure D-2. LAMARS Phase 2 Sum-of-sines Data, Case B, 30 deg/see 


Data Basis: 15Kft PA, 300 KiAS 
Test A/C: LAMARS Simuiation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 


Evaluation Piiot 


Figure D-3. LAMARS Phase 2 Sum-of-sines Data, Case B, 60 deg/see 
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PIOR PIOR 


Data Basis: 15KftPA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Heid 
Configuration: Cruise 
Test Dates: 22 August 2003 



Figure D-4. LAMARS Phase 2 Sum-of-sines Data, Case N, 15 deg/sec 


Data Basis: 15Kft PA, 300 KiAS 
Test A/C: LAMARS Simuiation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 
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Figure D-5. LAMARS Phase 2 Sum-of-sines Data, Case N, 30 deg/sec 


Evaluation Piiot 
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PIOR PIOR 


Data Basis: 15KftPA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



Evaiuation Pilot 


Figure D-6. LAMARS Phase 2 Sum-of-sines Data, Case N, 60 deg/sec 


Data Basis: 15Kft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



Evaiuation Pilot 

Figure D-7. LAMARS Phase 2 Sum-of-sines Data, Case W, 15 deg/sec 
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PIOR PIOR 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



Figure D-8. LAMARS Phase 2 Sum-of-sines Data, Case W, 30 deg/see 


Data Basis: 15Kft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 
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Figure D-9. LAMARS Phase 2 Sum-of-sines Data, Case W, 60 deg/see 


2 2 
Evaiuation Pilot 
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PIOR PIOR 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



Figure D-10. LAMARS Phase 2 Sum-of-sines Data, Case Y, 15 deg/see 


Data Basis: 15Kft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



Figure D-11. LAMARS Phase 2 Sum-of-sines Data, Case Y, 30 deg/see 
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PIOR 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



Evaiuation Pilot 


Figure D-12. LAMARS Phase 2 Sum-of-sines Data, Case Y, 60 deg/see 
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Handling Qualities Phase 3 Discrete HUD Pitch Tracking Task 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



Evaluation Pilot 


Figure D-13. LAMARS Phase 3 Discrete FIUD Pitch Tracking Data, Case B, 15 deg/sec 


Data Basis: ISKftPA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



Evaluation Pilot 


Figure D-14. LAMARS Phase 3 Discrete FIUD Pitch Tracking Data, Case B, 30 deg/sec 
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PIOR PIOR 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



D-15. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case B, 60 deg/sec 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



Figure D-16. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case N, 15 deg/sec 
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PIOR ^ PIOR 


Data Basis: 15Kft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Heid 
Configuration: Cruise 
Test Dates: 22 August 2003 



D-17. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case N, 30 deg/sec 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 
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Figure D-18. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case N, 60 deg/sec 


Evaiuation Pilot 
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PIOR PIOR 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



D-19. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case W, 15 deg/sec 


Data Basis: ISKftPA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Heid 
Configuration: Cruise 
Test Dates: 22 August 2003 
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Figure D-20. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case W, 30 deg/sec 


Evaiuation Pilot 
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PIOR PIOR 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



D-21. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case W, 60 deg/sec 


Data Basis: ISKftPA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Heid 
Configuration: Cruise 
Test Dates: 22 August 2003 
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Figure D-22. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case Y, 15 deg/sec 


Evaiuation Pilot 
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PIOR ^ PIOR 


Data Basis: 15KftPA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Heid 
Configuration: Cruise 
Test Dates: 22 August 2003 



D-23. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case Y, 30 deg/sec 


Data Basis: ISKftPA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 
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Figure D-24. LAMARS Phase 3 Discrete HUD Pitch Tracking Data, Case Y, 60 deg/sec 


Evaluation Pilot 
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PIOR PIOR 


Handling Qualities Phase 3 Target Tracking Task 


Data Basis: 15KftPA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Heid 
Configuration: Cruise 
Test Dates: 22 August 2003 



Figure D-25. LAMARS Phase 3 Target Tracking Data, Case B, 15 deg/sec 


Data Basis: ISKftPA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Heid 
Configuration: Cruise 
Test Dates: 22 August 2003 
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Evaluation Pilot 


Figure D-26. LAMARS Phase 3 Target Tracking Data, Case B, 30 deg/sec 
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PIOR PIOR 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



Figure D-27. LAMARS Phase 3 Target Traeking Data, Case B, 60 deg/see 


Data Basis: ISKftPA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Heid 
Configuration: Cruise 
Test Dates: 22 August 2003 
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Figure D-28. LAMARS Phase 3 Target Traeking Data, Case N, 15 deg/see 


Evaiuation Pilot 
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PIOR PIOR 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



Evaiuation Pilot 


Figure D-29. LAMARS Phase 3 


Target Tracking Data, Case N, 30 deg/sec 


Data Basis: ISKftPA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 
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Figure D-30. LAMARS Phase 3 Target Tracking Data, Case N, 60 deg/sec 


Evaiuation Pilot 
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PIOR ___ PIOR 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



Evaiuation Pilot 


J^igure D-31. LAMARS Phase 3 


Target Traeking Data, Case W, 15 deg/see 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 
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Figure D-32. LAMARS Phase 3 Target Tracking Data, Case W, 30 deg/sec 


Evaiuation Pilot 


D-17 







































PIOR ___ PIOR 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



J^igure D-33. 


LAMARS Phase 3 Target Traeking Data, Case W, 60 deg/see 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 
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Evaiuation Pilot 


Figure D-34. LAMARS Phase 3 Target Tracking Data, Case Y, 15 deg/sec 
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PIOR PIOR 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 



Evaiuation Pilot 


Figure D-35. LAMARS Phase 3 


Target Tracking Data, Case Y, 30 deg/sec 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: LAMARS Simulation 
Acquisition System: Hand Held 
Configuration: Cruise 
Test Dates: 22 August 2003 
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Figure D-36. LAMARS Phase 3 Target Tracking Data, Case Y, 60 deg/sec 


Evaiuation Pilot 
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PIO Tendecy Rating PIO Tendecy Rating 


MAX GAP (VISTA) Histograms 


Handling Qualities Phase 2 Sum-of-sines Task 


Data Basis; 15K ft PA, 300 KIAS 
Test A/C: NF-16D-# 86-00048 
Acquisition System: Hand Heid 
Configuration: Cruise / VSS Engaged 
Test Dates; 20-22 October 2003 



Evaiuation Piiot 


Figure D-37. VISTA Phase 2 Sum-of-sines Data, Case B, 15 deg/sec 


Data Basis; 15K ft PA, 300 KIAS 
Test A/C: NF-16D-# 86-00048 
Acquisition System: Hand Held 
Configuration; Cruise / VSS Engaged 
Test Dates: 20-22 October 2003 


2 2 
Evaluation Pilot 


Figure D-38. VISTA Phase 2 Sum-of-sines Data, Case B, 30 deg/sec 


D-20 



































































































Data Basis; 15K ft PA, 300 KIAS 
Test A/C: NF-16D - # 86-00048 
Acquisition System; Hand Held 
Configuration: Cruise / VSS Engaged 
Test Dates: 20-22 October 2003 



Evaluation Pilot 

Figure D-39. VISTA Phase 2 Sum-of-sines Data, Case B, 60 deg/see 


Data Basis: 15Kft PA, 300 KIAS 
Test A/C: NF-16D - # 86-00048 
Acquisition System; Hand Held 
Configuration: Cruise/VSS Engaged 
Test Dates: 20-22 October 2003 



Evaluation Pilot 


Figure D-40. VISTA Phase 2 Sum-of-sines Data, Case N, 15 deg/sec 
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PIO Tendecy Rating PIO Tendecy Rating 


Data Basis; 15KftPA, 300 KIAS 
Test A/C: NF-16D -# 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise/VSS Engaged 
Test Dates; 20-22 October 2003 


2 3 

Evaluation Pilot 


Figure D-41. VISTA Phase 2 Sum-of-sines Data, Case N, 30 deg/see 
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Evaluation Pilot 


Figure D-42. VISTA Phase 2 Sum-of-sines Data, Case N, 60 deg/sec 


D-22 



































































PIO Tendecy Rating PIO Tendecy Rating 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: NF-16D - # 86-00048 
Acquisition System; Hand Held 
Configuration: Cruise / VSS Engaged 
Test Dates: 20-22 October 2003 
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Evaluation Pilot 


Figure D-43. VISTA Phase 2 Sum-of-sines Data, Case W, 15 deg/see 


Data Basis; 15KftPA, 300 KIAS 
Test A/C; NF-16D -# 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise/VSS Engaged 
Test Dates: 20-22 October 2003 



Evaluation Pilot 

Figure D-44. VISTA Phase 2 Sum-of-sines Data, Case W, 30 deg/sec 
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PIO Tendecy Rating PIO Tendecy Rating 


Data Basis: 15K ft PA, 300 KiAS 
Test A/C: NF-16D - # 86-00048 
Acquisition System; Hand Heid 
Configuration: Cruise / VSS Engaged 
Test Dates: 20-22 October 2003 


Evaluation Pilot 


Figure D-45. VISTA Phase 2 Sum-of-sines Data, Case W, 60 deg/see 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: NF-16D - # 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise / VSS Engaged 
Test Dates: 20-22 October 2003 
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Figure D-46. VISTA Phase 2 Sum-of-sines Data, Case Y, 15 deg/sec 
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PIO Tendecy Rating PIO Tendecy Rating 


Data Basis; 15KftPA, 300 KIAS 
Test A/C: NF-16D -# 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise/VSS Engaged 
Test Dates: 20-22 October 2003 



1 


2 


2 


3 


Evaluation Pilot 


Figure D-47. VISTA Phase 2 Sum-of-sines Data, Case Y, 30 deg/see 


Data Basis; 15KftPA, 300 KIAS 
Test A/C: NF-16D -# 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise/VSS Engaged 
Test Dates: 20-22 October 2003 
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Figure D-48. VISTA Phase 2 Sum-of-sines Test Data, Case Y, 60 deg/sec 
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Handling Qualities Phase 3 Discrete HUD Pitch Tracking Task 


Data Basis; 15KftPA, 300 KIAS 
Test A/C: NF-16D -# 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise/VSS Engaged 
Test Dates; 20-22 October 2003 
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Figure D-49. VISTA Phase 3 Discrete HUD Pitch Tracking Data, Case B, 15 deg/sec 


Data Basis: 15KftPA, 300 KIAS 
Test A/C; NF-16D <# 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise/VSS Engaged 
Test Dates: 20-22 October 2003 



Figure D-50. VISTA Phase 3 Discrete HUD Pitch Tracking Data, Case B, 30 deg/sec 
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Data Basis; 15KftPA, 300 KIAS 
Test A/C: NF-16D - # 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise/VSS Engaged 
Test Dates: 20-22 October 2003 
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Evaluation Pilot 


Figure D-51. VISTA Phase 3 Discrete HUD Pitch Tracking Data, Case B, 30 deg/sec 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: NF-16D - # 86-00048 
Acquisition System; Hand Held 
Configuration: Cruise / VSS Engaged 
Test Dates: 20-22 October 2003 



Figure D-52. VISTA Phase 3 Discrete HUD Pitch Tracking Data, Case N, 15 deg/sec 
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Data Basis: 15K ft PA, 300 KIAS 
Test A/C: NF-16D - # 86-00048 
Acquisition System; Hand Held 
Configuration: Cruise / VSS Engaged 
Test Dates: 20-22 October 2003 
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Figure D-53. VISTA Phase 3 Discrete HUD Pitch Tracking Data, Case N, 30 deg/sec 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: NF-16D • # 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise / VSS Engaged 
Test Dates: 20-22 October 2003 



Figure D-54. VISTA Phase 3 Discrete HUD Pitch Tracking Data, Case N, 60 deg/sec 


D-28 










































Data Basis: 15K ft PA, 300 KIAS 
Test A/C: NF-16D - it 86-00048 
Acquisition System; Hand Held 
Configuration: Cruise / VSS Engaged 
Test Dates: 20-22 October 2003 
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Evaluation Pilot 


Figure D-55. VISTA Phase 3 Diserete HUD Piteh Traeking Data, Case W, 15 deg/see 


Data Basis: 15KftPA, 300 KIAS 
Test A/C; NF-16D -# 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise/VSS Engaged 
Test Dates; 20-22 October 2003 
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Figure D-56. VISTA Phase 3 Diserete HUD Piteh Tracking Data, Case W, 30 deg/sec 
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Data Basis: 15K ft PA, 300 KIAS 
Test A/C: NF-16D < # 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise / VSS Engaged 
Test Dates: 20-22 October 2003 
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Figure D-57. VISTA Phase 3 Diserete HUD Piteh Traeking Data, Case W, 60 deg/see 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: NF-16D - # 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise / VSS Engaged 
Test Dates: 20-22 October 2003 



Figure D-58. VISTA Phase 3 Discrete HUD Pitch Tracking Data, Case Y, 15 deg/sec 
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Data Basis: 15K ft PA, 300 KIAS 
Test A/C: NF-16D - It 86-00048 
Acquisition System; Hand Held 
Configuration: Cruise / VSS Engaged 
Test Dates: 20-22 October 2003 
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Figure D-59. VISTA Phase 3 Discrete HUD Pitch Tracking Data, Case Y, 30 deg/sec 


Data Basis: 15K ft PA, 300 KIAS 
Test A/C: NF-16D-# 86-00048 
Acquisition System: Hand Held 
Configuration: Cruise/VSS Engaged 
Test Dates: 20-22 October 2003 



Figure D-60. VISTA Phase 3 Discrete HUD Pitch Tracking Data, Case Y, 60 deg/sec 
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